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DATA TRANSFER AND SYNCHRONIZATION SYSTEM 

INVENTOR: 
David L. Multer 

Limited Copyright Waiver 

A portion of the disclosure of this patent document contains material 
to which the claim of copyright protection is made. The copyright owner has 
5 no objection to the facsimile reproduction by any person of the patent 
document or the patent disclosure, as it appears in the U.S. Patent and 
Trademark Office file or records, but reserves all other rights whatsoever 

BACKGROUND OF THE INVENTION 
10 Field of the Invention 

The invention relates to the transference of data between two 
systems independent of the form in which the data is kept on the respective 
systems, and in particular to providing an efficient means of communicating 
data between systems and devices. 

15 

Description of the Related Art 

The growth of computing-related devices has not been limited to 
personal computers or work stations. The number of personal computing 
devices has grown substantially in both type and format. Small, hand-held 
20 computers carry a multitude of contact, personal, document, and other 
information and are sophisticated enough to allow a user to fax, send e- 
mails, and communicate in other ways wirelessly. Even advanced cellular 
phones carry enough memory and processing power to store contact 
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information, surf the web, and provide text messaging. Along with the 
growth in the sophistication of these devices, the need to transfer 
information between them has grown significantly as well. 

With a multitude of different device types on the market, keeping 
information between the different devices synchronized has become 
increasingly problematic. For example, if an individual keeps a calendar of 
information on a personal computer in his or her office using a particular 
personal information manager application, the individual would generally 
like to have the same information available in a cellular phone, hand-held 
organizer, and perhaps a home personal computer. The individual may 
additionally have a notebook computer which requires synchronizing file 
data such as presentations or working documents between the notebook 
and the office computer. 

Until now, synchronization between both documents and personal 
information managers has occurred through direct connection between the 
devices, and generally directly between applications such as a personal 
information manager in one device and a personal information manager in 
another device or using an intermediary sync-mapping program. 

One example of this is the prevalent use of the 3Com Palm® OS- 
based organizer, such as the 3Com Palm® series of computing devices, 
which uses its own calendaring system, yet lets users synchronize the data 
therein with a variety of different personal information manager software 
packages, such as Symantec's ACT!™, Microsoft's Outlook®, and other 
systems. In this example, an intermediary synchronization program such 
as Puma Technology, Inc.'s Intellisync® is required. Intellisync® is an 
application program which runs on both the hand-held device and the 
computer which stores the information data and maps data systems 
between non-uniform data records. In other cases, direct transfer between 
applications such as transfer between Microsoft's Outlook® computer- 
based client and Microsoft's Windows CE "Pocket Outlook" application, is 
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possible. Nevertheless, in both cases, synchronization occurs through 
direct connection between a personal computer and the personal computing 
device. While this connection is generally via a cable directly connecting, 
for example, Palm® device in a cradle to the personal computer, the 
connection may be wireless as well. 

One component of these synchronization systems is that the 
synchronization process must be able to delineate between when changes 
are made to specific databases and must make a decision about whether 
to replace the changed field. Normally, this is measured by a change in one 
database, and no-change in a second database. In some cases, both 
databases will have changed between syncs. In this case, the sync 
operation must determine which of the two changes which has been made 
is to "win" and replace the other during the sync. Generally, this 
determinant of whether a conflict exists allows some means for letting the 
user resolve the conflict. 

In a technical sense, synchronization in this manner is generally 
accomplished by the copying of full records between systems. At some 
level, a user is generally required to map data fields from one application to 
another and specify which data fields are assigned to which corresponding 
field in a different device. Less mapping is required where developers more 
robustly support various platforms of applications. 

In many instances, the data to be synchronized is generally in the 
form of text data such as records of addresses, contact information, 
calendar information, notes and other types of contact information. In 
certain instances, data to be synchronized will be binary format of 
executable files or word processor-specific documents. In many cases 
where document synchronization is required, the synchronization routine 
simply determines whether or not the documents in question have changed , 
and uses a time-based representation to determine which of the two files 
is newer, and replaces the older file with the newer file to achieve 
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synchronization, as long as the older of the two files was in fact not 
changed. This is the model used in the familiar "Briefcase" function in 
Microsoft Windows-based systems. If both files have changed, then the 
synchronization routine presents the option of conflict resolution to the user. 
5 Such synchronization schemes are generally relatively inefficient 

since they require full band-width of the document or binary file to be 
transferred via the synchronization link. In addition, at some level the 
synchronization programs require interaction by the user to map certain 
fields between different programs. 
1 0 One of the difficulties in providing synchronization between different 

computing devices is that the applications and platforms are somewhat 
diverse. 

Nevertheless, all synchronization programs generally require certain 
functions in order to be viable for widespread usage. In particular, 

15 synchronization programs must work with popular applications on various 
platforms. Sync applications must allow for conflicts resolution when 
changes are made to the same information on different devices between 
syncing events. They must provide synchronization for all types of formats 
of data, whether it be text data in the form of contacts, e-mails, calendar 

20 information, memos or other documents, or binary data in the form of 
documents or programs in particular types of formats. 

In a broader sense, applications which efficiently synchronize data 
between disparate types of devices can provide advantages in applications 
beyond synchronizing individual, personal information between, for 

25 example, a personal information manager hardware device such as a 
Palm® computing device, and a personal computer. The same objectives 
which are prevalent in developing data transfer between personal 
information management (PIM) devices and desktop systems lend 
themselves to furthering applications requiring data transfer between other 

30 types of devices, on differing platforms. These objectives include speed, 
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low bandwidth, accuracy, and platform independence. 

For example, current e-mail systems use a system which is 
somewhat akin to the synchronization methods used for disparate devices 
in that an entire message or file is transferred as a whole between different 
systems. When a user replies to an e-mail, generally the entire text of the 
original message is returned to the sender, who now has two copies of the 
e-mail text he/she originally sent out. The same is true if an e-mail 
attachment is modified and returned. All of the text which is the same 
between both systems is essentially duplicated on the originator's system. 

SUMMARY OF THE INVENTION 

The invention, roughly described, comprises a difference information 
receiver, a difference information transmitter and a difference information 
synchronizer which cooperate in a system or device to update data in the 
device with data received from other systems, or provide data for other 
systems to use in updating themselves. 

In one aspect, the invention comprises a system in a device having 
at least one application data destination having a format. The system 
includes a difference engine receiving difference information associated 
with a change to said at least one application data destination; and an 
application interface, applying said difference information to said at least 
one data destination. 

The difference engine may comprise a data store reflecting 
application data at a state prior to receipt of said difference information; 
and a delta engine receiving difference information and comparing 
difference information to said data store to construct change information. 
Further, the difference information may comprises a data file containing 
change transactions which is combined with data in the data store. 

In a further aspect, the method may comprise a method for updating 
data files in a system. The method may include the steps of: receiving 
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difference information for a subset of said data files; and applying said 
difference information to said subset of said data files. In particular said 
step of receiving may comprise: receiving a change log detailing changes 
to data files on another system; and applying said changes to a data store 

5 containing data identical to said data files to generate changed data. 

In a further unique aspect, the invention my comprise an application 
in a system having a data source in a source format. The application may 
include an application interface, extracting data from said data source; and 
a difference engine receiving said data and outputting difference information 

1 0 associated with changes to said data source. The application interface may 
includes a source format interface; and a converter to map said data from 
said source format into a universal format. In addition, the difference 
engine may include a data store reflecting a prior state of said data; and a 
delta generator comparing said data and said data store to provide change 

15 transactions. 

In a still further aspect, the invention may comprise a method for 
updating a data source in a system. The method may include the steps of 
extracting difference information from at least a subset of said data source; 
and outputting difference information for at least the subset of said data 

20 source. The step of extracting may comprise determining whether changes 
have been made to the subset of data source in the system; and 
generating a change log detailing changes to the subset of data source on 
another system. 

In yet another aspect, the application of the present invention 
25 includes: an extraction routine for extracting a first set of difference 
information resulting from changes to the data files; a differencing 
transmitter for transmitting said first set of difference information to an 
output; a differencing receiver for receiving a second set of difference 
information from an input; and a reconstruction routine for applying the 
30 second set of difference information to the data files. 
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A further method of the invention comprises a method for updating 
data files in a system. The method includes the steps of receiving first 
change transactions for a subset of said data files; applying said change 
transactions to said subset of said data files, subsequent to a change in 
5 said data files, generating second change transactions for said file; and 
outputting said second change transactions to an output. 

In a particular embodiment, the invention comprises a device engine 
including an application object; an application object store; and a delta 
module. 

10 

BRIEF DESCRIPTION OF THE DRAWINGS 
The invention will be described with respect to the particular 
embodiments thereof. Other objects, features, and advantages of the 
invention will become apparent with reference to the specification and 
15 drawings in which: 

Figures 1 - 7 are block diagrams of various configurations of the 
system of the present invention utilizing the differencing routines of the 
present invention. 

Figure 8 is an overview of one embodiment of the system 
20 architecture in accordance with the present invention. 

Figure 9A is a block diagram of the desktop device engine of the 
present invention. 

Figure 9B is a block diagram of the configuration of server side 
device engines utilized in accordance with the present invention. 
25 Figure 1 0 is a block diagram of one embodiment of the device engine 

in an operating system such as Windows. 

Figure 11 is a block diagram of an application object incorporated 
into the device engine of the present invention. 

Figure 12 is a diagram of storage object hierarchy of a universal data 
30 format utilized with the system of the present invention. 
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Figure 13 is a listing of exemplary item objects used in accordance 
with the routines of the present invention. 

Figure 14 is a block diagram of a management storage server 
architecture for used in the system of the present invention. 
5 Figure 15 is a flow diagram illustrating a pull synchronization in 

accordance with the system of the present invention. 

Figure 16 is a flow diagram illustrating a push synchronization in 
accordance with the system of the present invention. 

Figure 17 is a diagram of the management server architecture in 
1 0 accordance with the present invention. 

DETAILED DESCRIPTION 
The present invention includes a system and a method for 
transferring data between two devices which require information to be 

1 5 shared between them, in accordance with the discussion herein, a "device" 
is defined as a collection of elements or components organized for a 
common purpose, and may include hardware components of a computer 
system, personal information devices, hand-held computers, notebooks, or 
any combination of hardware which may include a processor and memory 

20 which is adapted to receive or provide information to another device; or any 
software containing such information residing on a single collection of 
hardware or on different collections of hardware. Such software might 
include applications such as personal information managers, which include 
contact data and other such information, e-mail systems, and file systems, 

25 such as those utilized by Microsoft Windows NT operating systems, Unix 
operating systems, Linux operating systems, or other systems capable of 
storing file types having binary formats which translate to application 
formats of differing types. 

In one embodiment, the invention comprises a set of programs 

30 specifically designed to transmit and/or receive differencing data from one 
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device to another device, irrespective of the type of file system, data, 
content, or system hardware configuration. 

In a further aspect, the system comprises store and forward 
technology which utilizes the differencing technology to implement services 

5 via a public or private network, such as the Internet. 

The system of the present invention finds particular usages in 
synchronizing personal contact information between different systems, but 
it will be readily apparent to one of average skill in the art that the present 
invention provides advantages having broader applicability than merely 

10 synchronizing various types of systems. For example, replying and 
forwarding e-mail can be made more efficient by forwarding only the 
differences in e-mails between systems. As a further example, updates to 
systems software via a network can be made more efficient where, for 
example, instead of completely replacing different modules of an 

15 application, only the differences of the modules need be forwarded, 
resulting in more efficient use of existing bandwidth. 

System Overview 

Figures 1-7 show various configuration alternatives of the present 

20 invention. 

Figure 1 shows an embodiment of the present invention in a basic 
configuration. In Figure 1 , a first system or device, system A, and a second 
system or device, system B, are coupled by a communication line 110. It 
should be readily understood that communication line may be any direct 

25 coupling of the two systems which allows data to pass between the systems 
such as, for example, by means of serial ports, parallel ports, an Ethernet 
connection or other type of network, or an infrared link, or the like. System 
A includes a functional block 100 representing a differencing transmitter in 
accordance with the present invention. System B includes a functional 

30 block 102 representing the differencing receiver in accordance with the 
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present invention. 

The differencing transmitter 100, upon receipt of a control signal 
enabling operation of the transmitter, examines a specified data structure 
of information which is to be transmitted to system B. Differencing 
5 transmitter 100 extracts such information from System A and converts the 
information extracted into difference information A. Difference information 
A comprises only the changes to System B's data which have occurred on 
System B and instructions for implementing those changes. Hence, if the 
data to be transferred is a change to a file which exists on system B, 

10 difference information A comprises only the differences in such file and 
where such differences occur. If the data does not exist at all on System 
B, the difference information A will be the entire file. Difference information 
A received by differencing receiver 102 at System B is reconstructed at 
System B, and the changes reflected therein are updated on System B. 

1 5 For example, if System A and System B are two computers and an 

update for certain binary files on System A is required, the differencing 
transmitter on System A will extract the differences in the file known to exist 
on System B and any new files, and transmit only those differences (an 
instructions for where to insert those differences) to the differencing receiver 

20 102. Differencing receiver 102 will interpret the difference information (A) 
and reconstruct the binary files on System B. In this manner, the 
information on System B is updated without the need to transfer the entire 
binary files between the Systems. 

Figure 2 shows a second example of the system of the present 

25 invention. In Figure 2, both System A and System B include functional 
blocks 104, each representing a differencing synchronizer. The function of 
the synchronizer 104 is similar to that of the transmitter and receiver 
combined; the synchronizer will allow difference information A to be both 
transmitted and received. For example, System A and System B are a 

30 portable computer and a desktop computer, respectively, where information 
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such as contact information needs to be synchronized between the two, the 
differencing synchronizer 104 will extract changes made to the contact 
information on either System A or System B and at predetermined times, 
transmit the information A between the systems, and reconstruct the data 
5 on the receiving system to update information from the sending system, in 
order to ensure that both systems contain the same data. 

Figure 3 shows yet another alternative embodiment of the system of 
the present invention. In Figure 3, System A again includes a differencing 
transmitter and System B includes a differencing receiver 102. In this 

10 embodiment, a storage server 300 is coupled between System A and 
System B. Storage server 300 may store a separate database of the 
difference information A provided by System A, which allows System A to 
provide its difference information A to the storage server 300 at a first point 
in time, and storage server 300 to provide the same difference information 

15 A to System B at a second point in time, but not the same as the first point 
in time. In addition, multiple sets of difference information A may be 
provided at different points in time, and stored for later retrieval by System 
B. Still further, the difference information sets may be maintained on server 
300 to allow data on either System A or System B to be returned to a 

20 previous state. 

Once again, the storage server 300 is coupled by a direct connection 
1 10 to both System A and System B. Storage server 300 may be a server 
specifically adapted to receive differencing information A from the receiver 
100 and provide it to the transmitter 102. In one embodiment, server 300 

25 includes specific functional routines for enabling this transfer. Alternatively, 
server 300 comprises standard information server types which respond to 
standard Internet communication protocols such as file transfer protocol 
(FTP), or hypertext transfer protocol (HTTP). 

Figure 4 shows yet another alternative embodiment of the system of 

30 the present invention wherein System A and System B, once again coupled 
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directly to a storage server 300 by a direct connection line 110, each 
include a differencing synchronizer 104. Difference information A can be 
passed to and from System A through synchronizer 104 to and from the 
storage server 300 at a first point in time, and to and from System B at a 
second point in time. In this embodiment, storage server 300 may include 
routines, described below, for resolving conflicts between data which has 
changed on both System A and System B independently after the last point 
in times when the systems were synchronized. 

Figure 5 shows yet another alternative embodiment of the present 
invention including four systems: System A which includes a differencing 
synchronizer 104; System B which includes a differencing receiver 102; 
System C which also includes a differencing synchronizer 104; and System 
D which includes a differencing transmitter 100. Each is directly coupled to 
a storage server 300, allowing control of transmission of differencing data 
A between the various systems. Server 300 may include routines, 
described in further detail below, to track the various types of systems 
which comprise System A through System D, and which control the 
transmission of various components of the difference information A to each 
of the various systems. For example, since System B includes only 
differencing receiver 102, the difference information A 2 which is provided to 
it may be a sub-component of that which is transferred between System A 
in the storage server 300, or may be simply receiving broadcast information 
A 4 from System D. In one embodiment of the system of the present 
invention, server 300 does not itself route the difference information derived 
from each receiver/transmitter/synchronizer. Server 300 acts as a 
repository for the information, and the determination of which difference 
information A is attributed to which receiver/transmitter/ synchronizer is 
made by each receiver/transmitter/synchronizer. 

Figure 6 shows yet another alternative embodiment of the present 
invention. In Figure 6, a synchronizer is provided in storage server 300. 
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It should be recognized that a forwarder and/or receiver may be provided 
in server 300 as well. The particular embodiment shown herein may be 
advantageous where device processing power and memory are limited, 
such as cases where the device is a cell phone. It should be noted that the 
data transferred between system A and the device engine 104a in such an 
embodiment may or may not be difference information, depending on 
whether System A has the capacity to detect and output difference 
information. Each of the devices may include a differencing receiver, a 
differencing transmitter, or a differencing synchronizer, it should be 
understood that a portion of the differencing synchronizer 104a may reside 
on System A and another portion may reside on server 300. 

Figure 7 shows yet another alternative embodiment of the present 
invention wherein the devices shown in Figure 6 may be coupled to a 
combination of public or private networks 700 such as, for example, the 
Internet. The network 700 may include one or more storage servers 
300-5,3002, and in such cases the difference information A transmitted 
between each such device 602-610 via intermediate storage on one of such 
servers. Network 700 may couple the devices to one or more specialized 
function servers, such as servers specifically designed to include a 
differencing forwarder, receiver or synchronizer. Such devices may 
comprise, by way of example and without limitation, a personal office PC 
602, a smart telephone 604, a user's office PC 606, a personal information 
Palm® computing device 608, a telephone or cellular phone 604, a home 
personal computer 606, or a web browser 610. Each differencing receiver, 
differencing transmitter, or differencing synchronizer present in devices 602- 
610 includes means to poll the data stored on storage servers 300 1t 300 2 to 
determine whether the data present at storage server 300 1f 300 2 includes 
difference information which the particular receiver or synchronizer is 
required to have to synchronize the data on the device on which it resides. 

In the following description, an embodiment wherein the differencing 
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receiver, transmitter, and synchronizer are described will be discussed with 
respect to its use in synchronizing contact information, calendar information, 
and binary file information between a plurality of different devices in the 
context of data synchronization. It will be readily understood that the 
system of the present invention is not limited to synchronization 
applications, or applications dependent upon specific types of data, such as 
contact information or scheduling information. In particular, it will be readily 
understood that the transmission of data comprising only the differences in 
data between two systems via routines which extract the data and 
reassemble data on the various systems, represents a significant 
advancement in the efficient transmission of data. The present invention 
allows for optimization in terms of a reduction in the bandwidth utilized to 
transmit data between two systems, since only changes to data are 
transferred. This consequently increases the speed at which such 
transactions can take place since the data which needs to be transmitted 
is substantially smaller than it would be were entire files transferred 
between the systems. 

In a particular embodiment of the present invention, the ability of 
devices to connect to the Internet is leveraged to manage data transfer 
between the systems. In essence, each particular device which requires 
information access which can connect to the Internet may become part of 
the system of the present invention, and synchronize its data with other 
devices defined by a user as being part of the system. 

Generally, the system comprises client software which provides the 
functions of the differencing transmitter 100, differencing receiver 102, and 
differencing synchronizer 104 in the form of a device engine. The device 
engine includes at least one component particular to the type of device on 
which the device engine runs, which enables extraction of information from 
the device and conversion of the information to difference information, and 
transmission of the difference information to the storage server. This allows 
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the replication of information across all systems coupled to the system of 
the present invention. Although the storage servers 300 utilized in the 
system of the present invention may be any type of storage server, such as 
an Internet server or an FTP server, and may be provided from any source, 
5 such as any Internet service provider (ISP), particular aspects of a storage 
server which may be useful and which may be customized to optimize 
transfer of information between systems coupled as part of the present 
invention will be described below. Synchronization of devices utilizing the 
synchronization system of the present invention is possible as long as an 

10 Internet connection between the devices is available. 

In a key aspect of the invention, the Internet connection between the 
devices or between the devices and a server, need not exist at the same 
point in time, and new devices may be added to the system of the present 
invention at any point in time without the loss of information. The system 

1 5 provides totally transparent access to information and the device engine on 
each device provides an operating system independent extension which 
allows seamless integration of the personal information services in 
accordance with the present invention. 

In a particular unique aspect of the present invention, only those 

20 changes to the information which are required to be forwarded to other 
systems on the system of the present invention are transmitted to enable 
exceptionally fast response times. In a still further aspect of the invention, 
information which is transferred in this manner is encrypted to ensure 
security over the public portions of the Internet. 

25 

Architecture Overview 

Figure 8 shows an overview of the architecture of the system of the 
present invention utilized for synchronizing or "syncing" information on 
different types of devices. In the embodiment hereinafter described, the 
30 system of the present invention allows the coupling of a collection of 
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personal devices and applications one uses when working with personal 
information. Nevertheless, the system may be used to broadcast public or 
private information to various device types. System software in the form of 
a device engine for each device which is declared a part of the system of 
5 the invention is distributed across the collection of devices to enable 
synchronization. Distribution of the device engines may occur via, for 
example, an installation package forwarded over an Internet connection. 
In essence, the device engine software of the present invention forms a 
distributed processing network which maintains consummate 

10 synchronization of all information in the system. The processing load 
associated with delivering this service is pushed to the end-point devices 
which provides for easy scaling of the system to ever-larger applications. 

The present invention contemplates the use of two types of device 
engine: one totally embodied on the server which outputs change data to 

15 the server; and a second totally embodied on the server receiving device 
generated change information from the device. In addition, a hybrid of the 
two, having a portion of the device engine on the device and a portion on 
the server, is disclosed. 

As shown in Figure 8, any number and type of devices 802-808 may 

20 be utilized in accordance with the system of the present invention. A 
telephone 802 may comprise a' cellular phone or a standard POTS- 
connected telephone. Telephone 802 may include contact information and, 
as is supported with a newer generation of cellular telephones, 
appointments and task data stored in a data structure 81 2. The application 

25 812 which utilizes the application data 822 comprising such information is 
all stored in the telephone unit 802. Likewise, a personal digital assistant 
such as a Palm® computing device 804 includes application 814 and 
application data 824 which may include information such as contacts, 
appointments and tasks, and may also include file information such as 

30 documents which are created and stored on the PDA 804. Device 806 is 
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represented as a Windows personal computer running an operating system 
such as Microsoft Windows 95, 98, NT or 2000. Applications 816 which 
may be running on device 806 include the Windows operating system itself, 
Microsoft Outlook, Symantec's ACT Personal Information Manager, 

5 Goldmine Software's Goldmine, Lotus Organizer, Microsoft's Internet 
Explorer web browser, Netscape's Communicator Suite, Qualcomm's 
Eudora e-mail, and various other programs, each of which has its own set 
of application data 826 which is required to be synchronized not only with 
devices outside the system 806, but also between devices and applications 

10 within the system itself. Finally, a dedicated web browser client 808 is 
shown which couples via the Internet to web portal applications 816 which 
have their own set of application data 828. Unlike devices 806 which store 
the application and application data substantially in their own hardware, 
web portal applications are provided on a separate server and provided to 

15 browser 808 via an Internet connection. Nevertheless, the web portal 
application stored on the portal application provider includes a set of 
application data 828 which a user may wish to synchronize. For example, 
a large web portal such as Yahoo! and Snap.com provide services such as 
free e-mail and contact storage to their users. A user may wish to 

20 synchronize this with applications running on their cellular phone, PDA, or 
Windows devices. 

In order to access the specific application data of each of the 
systems shown in Figure 8, a device engine is associated with each type 
of device. A cellular device engine 862 communicates and incorporates 

25 itself with the application data 822 of the cellular phone. Likewise, a PDA 
device engine 864 is provided, which may be based on either the Palm® 
operating system, Windows CE operating system, or other PDA-type 
operating systems as necessary. A Windows-based device engine 866 
includes a mechanism, discussed below, for extracting application data 826 

30 from supported Windows applications 816, and a web services device 
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engine 868 incorporates to extract application data 828 from web portal 
applications 818. 

As shown in Figure 8, some device engines are provided entirely on 
the device (and are referred to herein as desktop device engines), while 
5 others include components a the back end server (which may comprise 
storage server 850 or a specialized server, as shown in Figure 9B.) This 
is illustrated generally by lines 832, 834,836, and 838 in Figure 8. Also, in 
Figure 8, elements above dashed line 855 are provided by an administrator 
or service provider of the system of the present invention. Each of the 

10 device engines 862, 864, 866 and 868 is configured relative to the type of 
device on which it resides. For example, the Cell phone device engine 862 
includes one or more components arranged on the phone while others are 
on server 850. Conversely, device engine 866 resides entirely on the 
windows device 806. 

15 Data from each of the devices is coupled via an Internet connection 

710 with a storage server 850. As noted above, storage server 850 may be 
a generic storage server or it may be a storage server specifically adapted 
for use with the system of the present invention as discussed below. One 
or more of the storage servers 850 are used to communicate transactions 

20 amongst the collection of systems 802, 804, 806, 808. It should be readily 
recognized that any number of different types of systems 802, 804, 806, 
808 may be provided in accordance with the present invention and 
incorporated into the system. However, for brevity, not all the different 
types of commercially available computing devices which are currently in 

25 use or in development, in which the system of the present invention may be 
incorporated, are listed. 

In its simplest embodiment, the storage sen/er 850 is simply a dumb 
storage server and each of the device engines transmits only difference 
information thereto to be stored in a particular location accessible by other 

30 device engines in the system. In one embodiment, each device engine 
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implements all processing required to keep all the systems fully 
synchronized. Only one device engine needs to be coupled to the storage 
server 850 at one particular point in time. This permits synchronization of 
multiple systems in a disconnected fashion. Each device engine will 
5 download all transactions encapsulating changes that have occurred since 
the last synchronization from the server and apply them to the particular 
device. 

The change or difference information (A) is provided in one or more 
data packages, the structure of which is described herein. Each data 

10 package describes changes to any and all transfer information across all 
device engines, including but not limited to application data, files, folders, 
application settings, and the like. Each device engine can control the 
download of data packages that include classes of information that apply 
to the specified local device 802, 804, 806 or 808 attached to that specific 

1 5 device engine. For example, device engine 862 will only need to work with 
changes to information describing contact names and phone numbers in 
application data 822, while device engine 866 will be required to work with 
changes to e-mail, changes to document files, notes, as well as contact and 
address information since the application data 826 is much more extensive 

20 than application data 822. 

Each device engine includes compression/decompression and 
encryption/decryption components which allow encryption and/or 
compression of the data packages transmitted across Internet connection 
710. It should be recognized that compression and encryption of the data 

25 packages may be optionally provided. It is not required in accordance with 
the present invention. Each device engine performs mapping and 
translation steps necessary for applying the data packages to the local 
format required for that type of information in the application data stores 
822-828. The device engine also includes components which allow it to 

30 track ambiguous updates in cases where users have changed data to a 
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particular data field on two different systems simultaneously since the last 
update. In this case, the device engine includes a mechanism for drawing 
this to the attention of the user and allowing the user to resolve the conflict. 

5 Device Engine Architecture 

Figure 9A illustrates a single device engine utilized with a generic 
application 810 and a generic storage server 850. Figure 9A illustrates a 
desktop device engine, since all processing occurs on the device and only 
difference information is transmitted to server 850. Nevertheless, an 

1 0 understanding of the desktop device engine will aid in understanding server 
side devices engines, hereinafter described. Shown in Figure 9 are the 
functional components of a device engine in block form and their 
interrelationship to each other. The device engine 860 is equivalent to the 
functional block of a differencing sequencer 104 shown in Figures 1-7. 

1 5 While the invention will be described with respect to the embodiment 

of the invention as a differencing synchronizer 104, it will be readily 
understood that portions of the functionality are utilized as needed in a 
forward-only (a differencing transmitter) or a receive-only (a differencing 
receiver) capacity as required by the particular application. 

20 As noted above, a device engine exists for each and every device 

that makes up a user's personal information network of devices in the 
system. As shown in Figure 9A, each device engine 860 includes an 
application object 910. The application object is specific to each particular 
application 810 and provides a standard interface between the device 

25 engine and the balance of the data transmission system of the invention, 
and the application 81 0. Details of the application object will be described 
in further detail below. The application object is a pluggable architecture 
which supports a wide variety of vendor-unique applications. The job of the 
application object is to map data from the application into a temporary or 

30 "universal" data structure by connecting to the application via any number 
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of standard interfaces to gain access to the applications data. The data 
structure of the application object puts the data in a generic or "universal 
data" format which may be used by the device engine components to 
generate data packages for provision to the storage server. 

5 Also provided is an application object store (AOS) 920 which 

includes a copy of the device's data at a point just after the previous data 
extraction and synchronization occurred. Application object store 920 is a 
mirrored interface which stores a snapshot of the previous state of the data 
from the application object 910 in the device engine. The size of the AOS 

10 will depend on the data being collected by each device engine. 

The generic output of the application object is provided to a delta 
module 950. Delta module 950 is a differencing engine which calculates 
differences in data between the output of the application object 910 and the 
copy of the data which is provided in an application object store (AOS) 920. 

15 The actual differencing and patch routine can comprise a routine such as 
XDelta or YDelta. The delta module 950 will be referred to herein 
alternatively in certain portions of the description as "CStructuredDelta." In 
addition, the difference information is alternatively referred to herein as a 
"change log." Each change log (or set of difference information) is a self 

20 describing series of sync transactions. As described below, the change log 
may be encrypted and compressed before output to the network. 

Hence, during a sync, the Application Object will, using a mechanism 
discussed below, extract the data of each application in the device and 
convert it to a universal data format. The delta module will then generate 

25 a difference set by comparing the output of the Application Object and the 
AOS. This difference information is forwarded to the encryption and 
compression routines for output to the storage server 850 in the form of a 
data package. Alternatively, the data from one application can be used to 
synchronize to data in another application in, for example, a windows 

30 environment, as shown by arrow 1050 in Figure 10. 
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It should be specifically noted that the application object may 
interface directly unstructured binary data or with structured application 
data. The differencing routine supports both uses of the delta module 950 
in comparison generation. 
5 In some cases, operation of the application object and delta module 

is simplified by the fact that some applications, such as PDA's, have the 
ability to output changes to its data. In such cases, the delta module 950 
need only provide the data into the data package, since comparison to an 
AOS is not required - the application already includes a mechanism for 

10 tracking changes made to its own data. However, in many cases the 
applications provide, at most, a standard interface to access the data, such 
as Microsoft's OBDC interface, the Microsoft standard Application 
Programming Interface (API), or other similar standard interfaces. 

Device engine 860 further includes a versioning module which 

15 applies a version number per object in the data package. As explained 
further below, each object in the data package is assigned a universally 
unique ID (UUID). Hence, unlike many prior synchronization systems, the 
system of the present invention does not sync data solely by comparing 
time stamps of two sets of data. Versioning module 915 allows each 

20 device engine to check the state of the last synchronization against data 
packs which have been provided to the storage server to determine which 
data packages to apply. This allows the device engine to sync itself 
independently of the number of times another device engine uploads 
changes to the storage server. In other words, a first device engine does 

25 not care how many times a second device engine uploads data packages 
to the server. 

An events module 925 controls synchronization initialization events. 
Items such as when to sync, how to sync, trigger the delta module 950 to 
perform a synchronization operation. 
30 A user interface 930 is provided to allow additional functional 
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features to a system user of the particular device to which the device engine 
860 is coupled. The user interface is coupled to a conflict resolution module 
940, a filtering module 945, and a field mapping module 935. Each of the 
modules provides the functionality both necessary for all synchronization 
5 programs, and which users have come to expect. 

Filtering module 945 allows filtering for types of content based on, for 
example, afield level content search. The field mapping module 935 allows 
for the user to re-map certain interpretations of items which were provided 
in the document stream. For example, if the device engine 860 is operating 

10 on a personal computer, and a synchronization is occurring between the 
personal computer and a notebook computer, and the user has a "my 
documents" directory on the personal computer which he wishes to map to 
a different directory on the notebook computer, the field mapping module 
935 allows for this re-mapping to occur. It should be recognized that the 

1 5 field mapping module allows for changes in directing the output of the data 
package. The field mapping module 935 is not necessary to map particular 
data fields of, for example, contact information from one application, such 
as Microsoft Outlook, to a different application, such as Symantec's ACT, 
as is the traditional use of field mapping and synchronizing applications. 

20 Delta module 950 is further coupled to a compression module 970 

and an encryption module 960. It should be recognized that the 
compression encryption modules need not be enabled. Any type of 
compression module 970, such as the popular PK Zip or Winzip modules, 
or those available from HiFn Corporation may be utilized in accordance with 

25 the invention. Moreover, any type of encryption algorithms, such as MD5, 
RCH 6, Two Fish, orBlowfish, or any other symmetric encryption algorithm, 
may be utilized. In one embodiment of the invention, encryption without 
compression is used. In a second embodiment of the invention, 
compression without encryption is used. In a third embodiment of the 

30 invention, neither compression or encryption is used, and in a fourth 
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embodiment of the invention, both compression and encryption are used. 

Versioning module 91 5 also allows the device engine 860 to support 
multiple users with distinct synchronization profiles. This allows multiple 
users accessing the same machine to each synchronize their own data set 
5 using the same device engine. For example, if the application 810 on a 
particular device comprises Microsoft Outlook on a personal computer, 
coupled to a Microsoft Exchange server, and Outlook is configured to have 
multiple user profiles, versioning module 915 will track the data applied 
through the device engine when a sync request occurs. This allows two 

1 0 users of the same Outlook client software which access different data sets, 
either in the client computer or on a separate server, to utilize the same 
device engine and the system of the present invention via the same 
machine. In a further embodiment, a particular device engine supports the 
use of foreign devices accessing the system via the same connection. 

1 5 Palm® devices, for example, use a cradle to connect to a computer and/or 
Internet connection. If a particular user wishes to allow another user to use 
his Palm® pilot cradle connection to synchronize the other user's Palm® 
pilot, the device engine can generate data packages to update the local 
application object store for the foreign device. The application object store 

20 can therefore be used as a temporary storage for cases allowing 
synchronization of foreign devices. 

The output of the device engine 900 comprises a data package 
which is output to storage server 850. As noted above, only one device 
engine need be connected to the storage server 850 at a given time. The 

25 data package can be stored on the storage server 850 until a request is 
made to a particular location of the storage server by another device 
engine. Likewise, delta engine 900 can query alternative locations on the 
storage server for access to synchronized data within the system of the 
present invention. Access to areas of the storage server is controlled by a 

30 management server (MS) described more fully below. In one embodiment, 
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each sync operation requires that the device engine for each device login 
to the management server to authenticate the device and provide the 
device engine with the location of the individual device's data packages on 
the storage server. 

5 Data packages may be advantageously provided to the device 

engine from the storage server in a streaming format, allowing processing 
to occur using a minimum of bandwidth and storage in the devices. The 
device engine 860 and particularly the delta module 950 interpret data 
packages based on the versioning information and the mirrored data 

10 present in the application object store 920. When data is returned to the 
delta module 950 from the storage server 850, the delta module returns 
differenced data to the application object 910 for the particular application 
which then translates the delta information into the particular interface 
utilized for application 810. Once a device engine has been fully applied all 

1 5 data packages from an input stream, it generates a series of data packages 
that describe the changes made on the local system. The device engine 
uses the local application object store 920 to keep track of the last 
synchronized version of each application's actual data, which is then used 
for the next data comparison by the delta module on the next sync request. 

20 Generated data packages can include operations and encode changes 
generated from resolving ambiguous cases as described above. 

Figure 9B depicts how server based device engines may be provided 
in the system of the present invention. The Palm® device example is 
shown in this embodiment, where the Palm® device has the capability of 

25 connecting directly to the Internet and a service provider's data center 900. 
The data center includes a firewall 975 to prevent unauthorized 
communications with servers resident in the data center 900 and protect 
integrity of the data. The storage server 850 may communicate directly 
through the firewall as may the management sewer (MS) 1410. 

30 Shown therein are two sync servers 982 and 984 each of which is 
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dedicated to syncing one particular type of application. Sync server 982 is 
dedicated to the Palm® device, while sync server 980 is dedicated to, for 
example, a portal application (PortaH). 

Since the Palm® Device 804a includes a mechanism for transmitting 
5 changes to its data directly, data may be transmitted using HTTP request 
and response via the firewall 975 to the sync server 982 where differencing 
and updating of data in the AOS can occur, after which changes can be 
downloaded to the Palm® 804a. 

The synchronization server is an application handles concurrent 

1 0 synchronization of user's data. Each Sync Server includes plug-in support 
for multiple devices to be synchronized using the same sync server 
executable. Each device type has it's own device name that identifies 
which AO / AOS components will be used during the sync. 

The sync server uses the concept of a universal data record in its 

15 internal sync differencing engine and when sending data to and retrieving 
from external entities such as the AOS and AO. Hence, in the Palm® 
application, the job of a server AO is simply to take the device-specific 
format of its record and convert into a universal record format. 

The Sync Server has a plug-in architecture so that 3rd party 

20 application partners can easily add their services into the server. Currently, 
if the server is operated in a Microsoft Windows NT Server, the sync server 
discovers the sync components via the Windows NT registry. In alternative 
embodiments, this function is performed in a Component Manger which 
operates on each sync server to manage processing by each of the AO and 

25 AOS on the server. Each AO and AOS are implemented as a stand-alone 
DLL that the Sync Server loads at initialization time, or when adding a new 
component via the Component Manager. 

Each sync server is shown as dedicated to a single application. 
However, a sync server may handle multiple device types. 

30 In the embodiment of Figure 9B, it should be noted that, depending 
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on the device type, there are different configurations for the AOS and AO's. 
For example, the Palm®'s AO data store 1 050 resides on the Palm® device 
804a itself and a separate AOS data store 1052 exists for this configuration 
(an Oracle database). In the case of Portah , the AOS and AO use the data 
5 store 1054. 

Device engines can generate additional data packages intended to 
resolve synchronization problems in other systems. For example, 
interfacing with the conflict resolution module 940, if the user makes a 
change to a particular data store on an application object on his Palm® 

10 pilot, then makes an additional change to a personal information manager 
(PIM) application on his personal computer, the user can specify that the 
change made on the personal computer will "win" when the conflict is 
detected by the A engine and the versioning information between the two 
devices. This is essentially a definition that one particular set of data is 

15 correct and should replace the second set of data. 

Figure 10 shows a specific embodiment of a desktop device engine 
utilized in, for example, a Microsoft Windows-based operating system 
environment. 

As shown in Figure 10, a Windows operating system may have at 
20 least three specific applications which may require synchronization. In 
Figure 10, the system includes Netscape Communicator application 1040 
having data such as bookmarks 1021, contacts 1022, and e-mail 1023; a 
Microsoft Outlook application 1 042 which includes contact information 1 024, 
calendar information 1025, e-mail information 1026, note information 1027, 
25 and tasks information 1028; and Windows operating system 1044 
information including Favorites data 1 029, file system information 1 030, and 
individual files 1031. 

Each particular application 1040, 1042, 1044 has an associated 
application object 1010, 1012, 1014. Each of the respective application 
30 objects provides data back to delta module 950 in a generic format which 
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is usable by the delta module in accordance with the foregoing description 
of the apparatus shown in Figure 9A. From Figure 10, it will be additionally 
seen how the delta module 950 may be utilized to synchronize data 
between applications running on the same particular server. The device 
engine hence does an intra-system sync such as, for example, between the 
contact information 1022 from Netscape and the contact information 1024 
from Outlook. 

Figure 10 further illustrates the modularity of the system of the 
present invention allowing the device engine to include any number of 
different application objects to be provided on a single device to incorporate 
all applications run on that device. 

In operation, during an installation of a device engine into a particular 
system, the installation program may be tailored to provide application 
objects which may be present on a given system. For example, and with 
reference to Figure 10, the installation program for a Windows machine will 
carry any number of application objects for systems and applications which 
may be present on a Windows machine. The installer will check for the 
presence of given applications, and allow the user to add additional 
applications which may be installed in locations that are not the normal 
default installation areas for application support by the application objects 
which the installer is carrying, or de-select certain applications which, for 
one reason or another, the user may not wish to install an application object 
for and render a part of the system of the present invention. 

Application Object Structure 

Figure 1 1 is a conceptual depiction of the structure of an application 
object. As noted above, the application object is a pluggable architecture 
which supports a wide variety of vendor-unique applications. The 
consistent and scalable architecture of the system of the present invention 
for device engines is maintained by encapsulating system-dependent 
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knowledge in a single component, i.e. the application object. As noted 
above, every application object supports a standard set of interfaces that 
every device engine understands. Each application object maps these 
standard interfaces of the capabilities of a particular vendor application. 
5 Hence, there will be as many application objects as there are application 
types. 

As noted above, there are different types of server and desktop 
device engines, some having application objects entirely on the server, 
while others have application objects entirely on the desktop. 

10 Each application object will include a connector 1110 which may 

comprise a generic interface to the particular application for which the 
application object store has been designed. For example, when connecting 
to a Palm® device, the connector will be an HTTP protocol request routine 
which interfaces with the Palm® device's own built-in synchronization 

15 manager, which provides an output of records which have been changed 
on the Palm® device. As in Figure 9B, since the Palm® outputs all the 
changes to its data via its own sync manager, in the Palm® application, the 
job of a server AO is simply to take the device-specific format of its record 
and convert into a universal record format. 

20 The connector provides access for the application object to remove 

the data field from a particular application and convert it to a universal 
record structure. In the desktop AO, where, for example the application 
object is designed for a Windows interface, the connector may be the 
Windows API and the job of the AO will be to translate data from, for 

25 example, the windows file system to a universal data format. This universal 
data structure is then used by the delta module 950 to build data packages 
to be used in synchronization between components of the systems provided 
in the network system of the present invention. 

Universal data structure mapping, used on desktop application 

30 objects, and universal data record mapping, used by the server device 
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engines, is further detailed below. 



Desktop Application Object 

Each Application Object (AO) is a software component that 
5 interfaces with the third party application APIs (Application Programming 
Interface) to provide the programming services to the delta module for 
extraction and deposition of information data from and to the third party 
application domain during synchronization. In addition, the AO maps the 
third party application data fields to system's domain. 
10 The AO service is a collection of COM (Component Object Model) 

objects that can be developed in conjunction with the third party Windows 
application APIs as a form of a DLL (Dynamic Linked Library) in C or C++. 
The DLL is loaded on demand at runtime during synchronization. It should 
be recognized that the application object need not be implemented using 
1 5 the COM model , but may be developed with other distributed object models. 

There are a number of the related subsystems and documents that 
the developer must be familiar with and this document has made many 
references to those subsystems during the course of presenting the AO. 

Change Log (CL) (or differencing information) , a data file which 
20 contains a series of synchronization transactions. 

DataPack, a compacted and encrypted Change Log. 

StructuredDelta, the delta module differentiation engine that 

generates differences between Application Objects and Change Log 

and AOS. 

25 • AOS, a database which resides locally on, for example, a windows 
machine. 

• MS, a management server that manages users' accounts, 
SS, an FTP or storage server that manages data packs. 
User Manager, a standalone Windows client Ul program that 
30 manages the synchronization process. 
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• ePortal, a web-based PIM portal site. 

piojtypes.h, a header file which contains the definitions of the 

system's supported data fields known as tags. 

Def.h, a header file contains the definitions of the system's 
5 constants. 

interfaces.h, a COM interface file contains AO interface definitions. 

Each AO has a COM interface-based design built-in. That is, instead 
of providing a set of traditional APIs as programming services, it provides 
a set of interface-based objects as programming services. 
1 0 Structured Delta, the delta module, the primary intended user of each 

AO. Structured Delta instantiates these COM objects and uses them 
throughout the synchronization session exclusively through the COM 
interfaces on those objects to interface with the third party application 
database. 

15 Each AO component consists of a set of objects that translate the 

third party application data into the universal data middle format which 
underpins the entire spectrum of PIM data regardless of which third-party 
application the data comes from. The objects in universal data format are 
device, (application) data class, store, folder, item, and data fields. 

20 The AO digests the third party application data of any kind and reduces it 
into a few handful simple objects and field types. These objects and field 
types are fed into Structured Delta engine and are compared by 
Structured Delta in order of their hierarchy. The resulting differences (add, 
delete, modify) are logged as transactions in the difference information. 

25 The data packs are transported to a storage server that may be actively 
managed by a management server for each individual user account and 
devices. 

StructuredDelta uses AO objects to access and modify the individual 
AO objects and data fields. AO objects serve as a buffer between individual 
30 application data and StructuredDelta so that StructuredDelta does not 
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require knowledge of each application and database. All AO objects are 
temporary and created in the space of each AO by Structured Delta through 
COM interfaces. AO objects are referenced when they are in use and they 
are freed when Structured Delta stops using them. One can think of AO 
5 objects as merely placeholders of each application objects for 
StructuredDelta to access. Once StructuredDelta has a particular 
Application's data, StructuredDelta would free AO objects immediately 
without storing them internally. 

10 AppObj 

AppObj is a root object of each AO component and there is one and 
only one per AO. AppObj provides an entry point into the individual 
application's database. StructuredDelta instantiates it and holds it on during 
the entire synchronization session and releases it afterward. AppObj offers 

15 a number of services such as what class of data it supports. The C++ 
example of AppObj's definition is shown below: 



class CMyFlAppObj : 



20 



25 



30 



public Item, 
public AppObj, 
protected Moduleldentity , 
protected DataClasslnf o , 
protected ItemTypelnf o, 
protected ItemFieldMap, 
protected Folderlnfo, 
protected DataFilelnf o , 
protected SynchNotify , 
protected ErrorMsg, 
protected Enumltems , 
protected Findltem, 
protected Modifyltem 



public : 



35 



CMyAppObj { HWND hWndParent ) ; 
-CMyFppObj () ; 
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AppObj can contain children objects. They are Store objects. 
Enumltems interface is used to enumerate Store objects. Findltem 
interface is used to find the contained objects. Modifyltern interface 
enables AppObj to create a new Store object. AppObj is created by 
5 Structured Delta calling CreateAppObject( HWND hWndParent, AppObj 
**ppObj). 



Store 

The Store object represents a database of the individual application 
10 information. If the individual application can handle multiple databases at 
same time, one needs multiple Store objects. One can think of Store object 
as a specialized Folder object, the root folder of each particular application 
data domain. The C++ example of Store's definition is shown below: 

class CMyStore : 
15 public Item, 

public ItemContainer , 

protected Enumltems, 

protected Findltem, 

protected FindltemByData , 
20 protected Modifyltern, 

protected ReadWrite 



25 



CMyStore ( ) ; 
-CMyStore () ; 



Store is a container of Folder objects. Enumltems interface enables 
the enumeration of its contained folders while Findltem and 
30 FindltemByData interface is used to find contained Folders or Item objects. 

Modifyltern and ReadWrite interface enables the modification of each 
application database. 



Folder 

35 Folder object is a specific data class of each individual application 

such as a table in the relational database or a collection of data records in 
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each application. For example, the applications contact collection can be 
thought as a Folder object. The C++ example of Folder's definition is shown 
below; 

class CMyFolder : 
5 public Item, 

public ItemContainer , 
protected Emimltems, 
protected Findltem, 
protected FindltemByData , 
10 protected Modifyltem, 

protected ReadWrite 

{ 

public : 

CMyFolder {) ; 
15 -CMyFolder ( ) ; 



Folder object is also container. It can contain Item objects as well 
as Folder objects. Enumltem interface allows the enumeration of either 
20 Folder objects or Item objects or both. Findltem and FindltemByData 
interface is used to find contained Folder objects or Item objects. 
Modifyltem and ReadWrite interface enables the modification of an 
application's data tables. 

25 Item 

Item object represents an individual entity of each application's 
domain specific data. Item object can be thought as a record of each 
application's relational table. Forexample, a contact, email, calendar, to-do 
item in the particular application can be thought of as an Item object. The 

30 C++ example of Item's definition is shown below: 

class CMyltem : 

public Item, 
protected Enuml terns , 
protected Findltem, 
35 protected Modifyltem, 

protected ReadWrite 

{ 

public : 

CMyltem (} ; 

40 -CMyltem () ; 

}; 
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item can contain Attachment objects only. Enumltems interface 
enables the enumeration of Attachment objects if any. Modifyltem and 
ReadWrite interface enables the modification of an application's records or 
data fields. 

5 

Attachment 

Attachment object is a specialized Item object that encapsulates an 
attachment data or relationship. Only Item can have Attachment objects. 
Attachment object can be thought as attachment data such as attached- 
10 email files. Attachment can also be thought as attachment relationship to 
other Item objects. The example of that is the distribution list (Item object) 
can contain contacts (Item objects). The C++ example of Item's definition 
is shown below: 

class CMyltemAttachment : 
15 public Item, 

protected ReadWrite, 
protected Modifyltem 



20 



public : 

CMyltemAttachment () ; 
-CMyltemAttachment ( ) ; 



25 Variant 

Variant object represents a data field of each particular application 
data. For example, a "first name' of a contact or the birthday date of a 
contact can be thought as Variant object. Structured Delta only understands 
Variant object and the types of data fields it encapsulated. Variant object 

30 can contain any one of the following data field type: 

struct Variant 

{ 

enumFieldTag tag; 

enumFieldDataFlag flag; // flags item fields as not 
35 known or otherwise special 

union 

{ 

short int i; // eFieldType_WORD 

LONG 1; // eFieldType_LONG 
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10 



DWORD 


dw; 


// 


eFieldType 


_DWORD 


unsigned int64 


qw ; 


// 


eFieldType 


_QW0RD 


UUID 


uuid; 


II 


eFieldType 


UUID 


DATE 


time ; 


ii 


eFieldType 


_DATE 


LPTSTR 


psz; 


// 


eFieldType^ 


^String 


Binary bin; 


// 


e F i e 1 dTyp e_B i nary 




Float 


f It; 


// 


eFieldType_ 


_Float 


Double 


dbl; 


// 


eFieldType_ 


^Double 


FICollection 


COll; 


// 







eFieldType_Col lection 
} Value ; 
Stream* 

}; 



strm; // eFieldType_Stream 



15 

Variant: :tag is an identification tag of data field and variant: :flag 
specifies the type of data field while Variant: rvalue member variable stores 
each application's field value. One data field type is Collection. 
Collection object is an array of Variant objects. It can be used to represent 
20 a compound data fields. 

struct Collection 
{ 

ULONG c Value s ; 

struct_Variant** paVar; // This array really 

25 contains cValues entries 

}; 



Another data field type that is worth exploring is Binary. Binary 
30 object can be used to represent a binary data as it is. 

struct Binary 
{ 

ULONG cb; 
LPBYTE lpb ; 

35 }; 



AO Interfaces 

40 Each AO object has an AO COM interface. Each object must 

implement some of those interfaces to create certain capability or desired 
behavior that are expected by StructuredDelta. 
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lltem 

This is the base interface of ail application objects. It provides the 
identification service to StructuredDelta. Every object must have a unique 
ID, parent unique ID, display name, and item type information 
5 {eltemType__FOLDER, eltemType_CONTACT, etc). The unique ID is a 
unique string only in a given device. It is not persistent cross the Internet 
to other devices. The ID usually comes from the third party application 
database domain such a unique ID of a record. 

interface litem : IUnknown 

10 { 

STDMETHOD_ (LPCTSTR, GetUniquelD) () const PURE; 
STDMETHOD__ (LPCTSTR, GetParentUniquelD} {) const PURE; 
STDMETHOD_ ( LPCTSTR / GetDisplayName ) {) const PURE; 
STDMETHOD_(enumItemType / Get ItemType ) {) const PURE ; 
15 STDMETHOD_(BOOL, IsContainer) {} const PURE; 

STDMETHOD_ (DATE , GetLastModi f icat ionTime) 0 const PURE; 
STDMETHOD_(QWORD / GetSize) () const PURE; 
STDMETHOD_ (DWORD, GetFlaas) {} const PURE; 

}; 

20 

lltemContainer 

This is the base interface of all application container objects (store, 
folder). These container objects must have this interface implemented so 
that StructuredDelta would recursively descend in them if they have 
25 lltemContainer capability. 

interface lltemContainer : litem 
{ 

STDMETHOD_ (BOOL , Contains ItemType) { enumltemType eltemType ) PURE ; 
STDMETHOD__ ( BOOL , ContainsDataClass ) ( enumDataClass eDataClass ) 

30 PURE ; 

STDMETHOD_(enumSpecialFolderType, GetSpecialFolderType ) () PURE ; 
STDMETHOD_ (GUID, GetMappingGUID) () PURE; 

}; 

35 

lErrorMsq 

This is an error-reporting interface for every application object. It is 
used by StructuredDelta to query the error string after a failure. The AO 
should implement this on every object after the error occurs and before 
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returning the control to Structured Delta. 

interface IErrorMsg : IUnknown 

{ 

STDMETHOD(GetErrorString) ( LPTSTR pszError, int iBufLen ) 
5 const PURE ; 

}; 



lEnumltems 

This is an interface for collection enumeration, used by 
Structured Delta to enumerate the objects of the third party application 
database. lEItemEnumFIags {eltemEnumFlags__FOLDER, 
eltemEnumFlagsJTEM, and eltemEnumFlags_A TTACHMENT) is used to 
enumerate only the requested type of objects. 

interface lEnumltems : IUnknown 
{ 

STDMETHOD (ItemQueryStart) ( enumltemType type, long 
&lCount, eltemEnumFlags dwFlags ) PURE; 

STDMETHOD ( ItemQueryNext ) { Item **ppltem ) PURE ; 
STDMETHOD { ItemQueryFinish) ( ) PURE ; 

}; 



IFindltem 

25 This is an interface for recursively finding object within the third party 

application database, used by Structured Delta to find application object by 
its unique ID. 

interface IFindltem : IUnknown 



30 



35 



{ 



STDMETHOD (FindStoreBylD) { LPCTSTR pszUniquelD, ItemContainer 

**ppFolder } PURE; 
STDMETHOD (FindFolderBylD) ( LPCTSTR pszUniquelD, ItemContainer 

**ppFolder ) PURE; 
STDMETHOD (FindltemBylD) { LPCTSTR pszUniquelD, Item **ppltem ) 

PURE ; 



IFindltemBvData 

This is an interface for recursively finding the object that matches the 
search criteria data. The search criteria are represented as Collection that 
allows the multiple search field keys to be used during the search. The 
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multiple objects may be found that match the search criteria. The interface 
also provides enumeration capability of the search results. 

interface IFindltemByData : lUnknown 

5 STDMETHOD(FindByDataStart) ( enumltemType type, Variant* 

pSearchKey, int* pnFound ) PURE; 

STDMETHOD ( FindByDataNext ) ( LPTSTR pszEntrylD, int 
cbBufSize ) PURE; 

STDMETHOD ( FindByDataFinish) ( ) PURE ; 

10 }; 



IModifvltem 

This is an interface for StructuredDelta to add, delete, and re-parent 
15 application data in the third party database during synchronization. 

interface IModifyltem : lUnknown 

{ 

STDMETHOD (Add) ( BOOL bFolder, enumltemType type, Item 
**ppltem ) PURE; 
20 STDMETHOD (Delete) () PURE; 

STDMETHOD (Move) ( ItemContainer * pDestFolder ) PURE; 

}; 



25 

l Read Write 

This is an interface for accessing, writing, and mapping the third 
party application data fields by StructuredDelta. It provides the capability 
of read and write data fields from and to the third party application database 
30 and the capability of mapping data field of the third party application to 
universal data format of the system of the present invention. Any object that 
has data fields and require field level synchronization must implement this 
interface. 

interface IReadWrite : lUnknown 

35 { 

STDMETHOD (Read) ( ) PURE ; 
STDMETHOD ( Commi t ) ( ) PURE ; 

STDMETHOD (GetFieldData) ( enumFieldTag fieldTag, Variant 
**ppVariant ) PURE; 

40 STDMETHOD (ReleaseFieldData) { Variant *pVariant ) PURE; 

STDMETHOD (SetFieldData) ( const Variant *pVariant ) PURE; 

}; 
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lAppQbi 

This is an AppObj only interface, it provides the capability of logon 
and logoff to the third party applications during synchronization. The data 
class filter mechanism is used by StructuredDelta to filter the enumeration 
of contained data classes (eDataClass_CONTACT, 
eDataClass_CALENDAR, etc). 

interface IAppObj : I Unknown 

{ 

STDMETHOD (Logon) ( HWND hWndParent ) PURE; 
STDMETHOD (Logoff) () PURE; 

STDMETHOD (SetFilter) ( const VOID* pFilter, int BufLen ) 

PURE ; 

STDMETHOD_ ( int , GetFilter) ( VOID* pFilter, int BufLen ) 

PURE; 

}; 



IModuleldentitv 

This is an AppObj only interface. it provides DLL module 
identification information to the Manager object such as the name of the 
third party application, enum ID of this application, and the application 
installation detection support. 

interface IModule Identity : IUnknown 

{ 

STDMETHOD (GetName) ( LPTSTR pszName, int iBufLen ) const 

PURE; 

STDMETHOD (GetAppl) ( Appl *pAppl } const PURE; 

STDMETHOD deinstalled) { BOOL *blslnstalled ) const PURE; 

} / 



lltemTvoelnfo 

This is an AppObj only interface. It provides the information on the 
number of item types supported by AO, what type items are supported and 
the capabilities for a specific item type. This returns a DWORD containing 
bits set. 

interface IltemTypelnf o : IUnknown 
{ 
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STDMETHCD(GetSupportedTypesCount) ( int &iCount ) PURE; 
STDMETHOD(GetSupportedTypelnfo) { int ilndex, enumltemType 
&type, LPTSTR pszTypeName , int iBufLen ) PURE; 

STDMETHOD (Get ItemTypeCaps ) ( enumltemType type, DWORD 
O &dwFlags ) PURE; 

}; 



10 IDataCiasslnfo 

This is a CAppObj only interface. It provides the information on the 
number of data classes that are supported by the application object and 
what the data classes are supported 

interface IDataCiasslnfo : IUnknown 



15 



20 



STDMETHOD (Get Count) ( int *piCount ) PURE; 
STDMETHOD (GetDataClass) ( int ilndex, enumDataClass 
*peDataClass ) PURE; 

}; 



IDataFilelnfo 

This is a CAppObj only interface, it provides information on the 
number of database files and database filenames supported by AO to avoid 
being synched twice by application sync and file-set sync. 

25 interface IDataFilelnfo : IUnknown 

{ 

STDMETHOD (GetDataFileCount) ( int *piCount ) PURE; 
STDMETHOD (GetDataFilePath) ( int ilndex, LPTSTR 
pszFilePath, int iBufLen ) PURE; 

30 }; 



UtemFieldMap 

35 This is a CAppObj only interface that is used by Structured Delta to 

query the data fields of given application object. For example, what are 
data fields in application object called eltemType_CONTACT? 

interface UtemFieldMap : IUnknown 
{ 

40 STDMETHOD {FieldQueryStart} ( const enumltemType &type, int 

&i Count ) PURE; 

STDMETHOD { FieldQueryNext } ( enumFieldTag &field, LPTSTR 
pszName, int iBufLen, LPTSTR ps z Type, int iTypeBufLen ) PURE ; 
STDMETHOD (FieldQueryFinish) () PURE; 

45 }; 
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IFolderlnfo 

This is a CAppObj only interface, used by Structured Delta to obtain 
the special and default folders' unique IDs and UUIDs. 

interface IFolderlnfo : IUnknown 
{ 

STDMETHOD { GetSpecialFolderlD) ( enumSpecialFolderType 
eFolder, LPTSTR pszUniquelD, int iBufLen ) PURE; 

STDMETHOD (GetDef aultFolderlD) ( enumltemType type, LPTSTR 
pszUniquelD, int iBufLen ) PURE ; 

STDMETHOD (MapFolderGUID) { UUID uuidFolder, LPTSTR 
pszUniquelD, int iBufLen ) PURE; 

}; 



IFastSvnc 

This is a CAppObj only interface that is used by Structured Delta to 
query if the given AO also provides FastSync service or not. FastSync is 
a DLL component that is written using the third party APIs and loaded into 
the third party application to receive the changes in database while users 
are operating the application. It is used to speed up the synchronization 
performance by syncing only the objects that are known to IFastSync 
component. 

interface IFastSync : IUnknown 
{ 

STDMETHOD (Get FastSync) ( enumDataClass eDataClass, BOOL* 
pbFastSync ) PURE; 
}; 



SvnchNotifv 

This is a CAppObj only interface that is called by Manager to notify 
the third party application the state of synchronization: start, finished, or 
reset so that the application can prepare itself accordingly. 

interface ISynchNotify : IUnknown 

{ 

STDMETHOD (SynchNot if y) ( enumSynchKotif y eNotify ) PURE; 
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Server AO 

Server Application Objects share many characteristics with desktop 
application objects, including support for reading and mapping to the 
5 universal record structure set forth above. 

Nevertheless, among various devices incorporated into the system 
of the present invention, each application object database will be quite 
different. For example, the Palm® database on the device is really just a 
memory space with records laid out sequentially in memory. In a web 
10 portal-type application, the application object may be an Oracle database. 
Server application objects may generally have less difficult tasks since the 
applications supported are generally either devices providing their own 
change data output, (such as Palm®-type PDA's), or which do not have a 
great deal of data to export (such as cell phones, having only name and 
1 5 number information). 

Nevertheless, each application object must support all calls defined 
in a class interface definition as follows: 



20 



FUNCTION 


DESCRIPTION 


Open 


Perform an initialization of the device before 
data retrieval functions are called. 


Close 


Done with database calls, cleanup if 
necessary. 


Get First Modified Record 


Get the first modified record from the device 
and insert into application object. 


Get Next Modified Record 


Get the next modified record from the 
device and insert into the application object. 


Add Record 


Add a record into the application object 
database. 


Update Record 


Update a record. 


Delete Record 


Delete a record in the application object 
database. 
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Set Device Records 


A function called during the synchronization 
manager to send a bytestream to the 
application object for interpretation. The 
bytestream will contain a list of records to 
add to the application object modified 
records list. At a later point in time, such 
records will be retrieved by the Get First 
Modified Record/Get Next Modified Record 
functions. 


Get Device Records 


For records bound to the device, this call 
gets a bytestream that contains a list of 
records to add back to the device. There is 
an outbound record list that is saved until 
this call is finished, at which time the sync 
server will be finished with the application 
object. 


Set Device Response 


A function used to modify or repair a record 
input saved in the application object store 
that was sent to the device in the Get 
Device Records call, such as a record ID for 
a record, if 10 records were sent to the 
device during the Get Device Records call, 
one would expect to see 10 records coming 
back in during this function call. 



As noted above, because each application object database is 
different, the calling convention and the application object itself will likewise 
be different. The calling convention for a Palm® device's sync manager 
application object is given in the following pseudo-code: 



10 



Call AO: :Open 

Call AO: : WriteRecords 



15 



20 



25 



Start synchronization process 

While more records in AO Data Object 

Call AO: : GetFirstModif iedRecord C ) 
Call AO: : GetNextModif iedRecord ( ) 

END 

IF new records THEN 

Call AO: :AddRecord{) 
IF deleted records THEN 

Call AO: : DeleteRecord ( ) 
IF update record THEN 

CALL AO: :UpdateRecord{) 



Call AO: : Close 
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As shown therein, the calling convention is designed to be integrated with 
the Palm's® own sync manager. 

A second example provided below shows mapping of a portion of a 
web portal's contact database: 



Mappingltem CContactTable : :tn_FieldMap [] = 

{ 



1/ 


eFieldTag_ 


_Contact 


_FirstName, "fi 


rstname" } , 




1/ 


eFieldTag_ 


_Contact_ 


_MiddleName, "mi 


ddlename" } , 




1, 


eFieldTag_ 


_Contact 


_LastName , 


" lastname " } , 




1, 


eFieldTag_ 


_Contact_ 


JTitle, 


"title"} , 




1, 


eFieldTag 


Contact 


_Suf f ix, 


" suffix" } , 




1, 


eFieldTag_ 


_Contact_ 


_Anniversary / 


"anniversary 




1, 


eFieldTag_ 


_Contact_ 


_Birthday, 


"birthday" } , 




1/ 


eFieldTag_ 


^Contact 


_AssistantName , 


"assistantname " } , 


1, 


eFieldTag_ 


_Contact 


^Children, 


"children" } , 




1/ 


eFieldTag^ 


_Contact_ 


_CompanyName , 


" companyname 


■h 


1, 


eFieldTag_ 


_Contact_ 


JDepartment , 


" department " 


}. 


1, 


eFieldTag_ 


_Contact_ 


_FTPSite, 


" f tpsite" } , 




1, 


eFieldTag_ 


_Contact 


_Gender , 


"gender" } , 




1, 


eFieldTag_ 


^Contact 


_JobTitle, 


" jobtitle" } , 




1, 


eFieldTag_ 


_Contact^ 


ManagerKame , 


" manage rname 


-h 


1, 


eFieldTag_ 


_Contact_ 


_NickName, 


"nickname" } , 




1, 


eFieldTag_ 


_Contact_ 


_Of f ice, 


"office"} , 




1, 


eFieldTag_ 


_Contact_ 


_Prof ession, 


"profession " 


). 


1, 


eFieldTag_ 


Contact 


_Spouse , 


"spouse" } , 




1, 


eFieldTag_ 


_Contact_ 


_SelectedMaili ng Add 


ress, 






"selectedmailingaddress" } 







}; 

int CContactTable : :m_nNumFie Ids - 
sizeof (m_FieldMap) /sizeof (Mappingltem) ; 

HRESULT CPortalAddrOCI : : InsertRecord ( Mappingltem theMapf], int 
numFields, CDataAccessor *plnsertltem, CFlItemUniversal *pUnivItem / 
bool bForceCreate ) 

{ 

bool bHasData = SetRecordFields { theMap, numFields, plnsertltem, 
pUnivItem ) ; 

if( bHasData || bForceCreate ) 

{ 

// Insert the record into the database and execute the command 
pInsertItem->InsertRow(0 ) ; 
pInsertItem->Exec ( ) ; 

} 

return S__OK; 

} 

The above example of mapping the contact field files maps contact 
fields from a particular web contact information database to fields in the 
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universal record format from the master list header file (piojypes.h) in the 
system of the present invention. This mapping is for a specific contact table 
and it should be understood that other information, such as phone numbers, 
e-mail addresses, and other contact information may be stored in a 
separate table. 

Once data is extracted from a particular application, the server 
application object must then convert the information into the universal 
record format which can be utilized by other server device engines to take 
content information into their own particular application. 

Universal Record Format 

The universal record format is used by each server device engine to 
handle various tasks of encapsulating records in a common format, 
comparing records, creating and holding differences between records, and 
other tasks of synchronization. 

The universal record format allows the application objects to support 
a wide range of extensible application item types such as contacts, 
calendar, mail, bookmarks, and the like. Flexible type name and value 
associations permit synchronization without regard to individual vendor 
application information formats. Each application object encapsulates 
mapped knowledge from the vendor unique format to the universal format 
of the present invention. As such, an application object can be designed to 
support any combination of application and binary information types. In 
essence, application objects can be designed to support a vendor 
application using only binary file synchronization if the internal format of the 
application is not known. 

Server application objects can also be designed to create 
collections. For example, if the user wishes to create a "my pictures" 
collection which consists of some collection of information and synchronize 
this collection of information, such an arbitrary grouping of classes of 
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information into appropriate representations is supported. 

Because the connector layer of the interfaces to the actual storage 
with a vendor application varies with application type, application access 
methods can include, but are not limited to, disk or database access, 
network protocols, wireless device protocols, and the like. 

The Universal Records Format and the Universal Field Format class 
definitions are given below: 



typedef map < enumFieldTag, CUniversalField, less_enumFieldTag > 
Univer salRecordMap ; 

typedef UniversalRecordMap : : value_type UniversalRecordPair; 
typedef UniversalRecordMap :: iterator UniversalRecordlterator ; 
typedef UniversalRecordMap: : const_iterator 
ConstUniversalRecordlterator ; 

class CUniversalRecord 

{ 

private : 

UniversalRecordMap recordMap_; 

public : 

bool conflicts (const CUniversalRecord^ rhs) ; 
bool add (const CUniversalRecord &rhs) ; 
bool subtract (const CUniversalRecord^ rhs); 

CUniversalRecord ( ) ; 

CUniversalRecord ( const CUniversalRecord^ rhs ) ; 
virtual -CUniversalRecord () ; 

// add this element 

HRESULT insert ( enumFieldTag eld, long value, 
enumFieldDataFlag flag = eFieldDataFlag__Normal ) ; 

HRESULT insert ( enumFieldTag eld, LPCTSTR value, 
enumFieldDataFlag flag = eFieldDataFlagJSformal ) ; 

HRESULT insert { enumFieldTag eld, DATE value, 
enumFieldDataFlag flag = eFieldDataFlag_Normal ) ; 

HRESULT insert ( enumFieldTag eld, string value, 
enumFieldDataFlag flag = eFieldDataFlag_Normal ) ; 

HRESULT insert ( UniversalRecordPair p ) ; 

CUniversalRecord exclusiveLef twins ( CUniversalRecord& rhs ) ; 
CUniversalRecord inclusiveLef twins { CUniversalRecord^ rhs }; 
bool remove Same (const CUniversalRecord &rhs) ; 

bool Find{ const enumFieldTag eld, CUniversalField afield ) ; 
UniversalRecordMap: : iterator find( const enumFieldTag eld ) { 
return recordMap_ . find (eld) ; } 



UniversalRecordMap: : iterator begin () { return 

recordMap_ . begin ( ) ; } 

UniversalRecordMap: : iterator end ( ) { return 

recordMap_ . end ( ) ; } 

bool empty () { return 
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recordMap_. empty { ) ; } 

long sizeO { return 

recordMap_. size ( ) ; } 

UniversalRecordMap : : iterator erase (UniversalRecordMap : : iterators 

it) 

{ return recordMap__. erase (it) ; } 
void clear () { recordMap_. clear () ; } 



The UniversalField Structure 

class CUniversalField 

{ 

public : 

enum eUniversalField 

{ 

eUF_Un known , 
eUF_Long , 
eUF__String, 
eUF_Date , 
eUF__Blob 

}; 

protected: 

eUniversalField 
enumFieldTag 
enumFieldDataFlag 
size_t len_; 

union 

{ 

long 1 ; 
DATE d ; 
TCHAR* pCh; 
} value_; 

public : 

CUniversalField ( ) ; 

CUniversalField { const CUniversalField& rhs } ,- 

CUniversalField ( enumFieldTag itemld, long value, 
enumFieldDataFlag flag = eFieldDataFlag_Normal ) ; 

CUniversalField ( enumFieldTag itemld, DATE value, 
enumFieldDataFlag flag = eFieldDataFlag__Normai ) ; 

CUniversalField ( enumFieldTag itemld, LPCTSTR value, 
enumFieldDataFlag flag = eFieldDataFlag_Normal ) ; 

CUniversalField ( enumFieldTag itemld, string blob, 
enumFieldDataFlag flag = eFieldDataFlag_Normal ) ; 

-CUniversalField ( ) ; 

bool operator^ { const CUniversalField& rhs ) const; 

bool operator I = ( const CUniversalField& rhs ) const { return 

I operator== { rhs ) ; } 
CUniversalField& operator= { const CUniversalField& rhs); 

eUniversalField getType ( ) const { return typeld_; } 
enumFieldTag getFieldID ( ) const { return fieldld_; } 



typeld_; 
f ieldld_; 
f lag_; 
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enumFieldDataFlag getFlagO const 
size_t getLengthO const 



LPCTSTR getStringO const 
typeld_) ; return value_.pCh; 
long getLongO const 
typeld__) ; return value_.l; } 
DATE getDateO const 
typeld_) ; return value__.d; } 
string getBlob ( ) const 
typeld_) ; return string (value 

void get( LPCTSTR& p ) const 

} 



,pCh 



typeld_) ; p = value_.pCh; 
void get( long& 1) const 
typeld_) ; 1 = value_.l; } 
void get ( DATE& d) const 
typeld_) ; d - value_.d; } 

void get ( strings b) const { ASSERT ( eUF_Blob = 
typeld_) ; b. assign (value_.pCh, len__) ; } 



return flag_; } 
return len_; } 

ASSERT { eUF__String 

ASSERT ( eUF_Long == 

ASSERT ( eUF_Date == 

ASSERT ( eUF_Blob == 
,lenj; } 



ASSERT ( eUF_String == 
ASSERT ( eUF_Long == 



ASSERT ( eUF Date = = 



}; 



bool isStringO const 

eUF_String; } 
bool isLongO const 
bool isDateO const 
bool isBlob ( ) const 



{ return typeld___ == 

{ return typeld_ == eUF_Long 
{ return typeld_ =- eUF_Date 
{ return typeld_ == eUF_Blob 



Example 

An example of how data is removed from one particular application data 
type and converted into the universal record format is given below for an 
Oracle database: 

# include "stdafx.h" 

#include <string> 
using namespace std; 
#include "FlltemUniversal . h" 

# include "oci.h" 

#include "OCIDefs.h" 

#include "OCIConnect . h" 

#include "OCISession . h" 

#include "OCIColumn . h» 

#include "OCICursor .h" 

#include "DataAccessor . h" 

#include "UniversalMapper . h ,r 
#include "UniversalRecord . h" 
#include "FlUtil.h" 

#include "BaseAOSTableOCI . h" 
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/* 

* Function: MapFields 
5 * Description: Map fields from an Oracle database record into an 

UniversalRecord format. 

*/ 

void CBaseAOSTableOCI : :MapFields ( CDataAccessor *pAccessor, Mappingltera 

10 theMap[], int numFields, CUniversalRecord &univRec ) 

{ 

string sValue; 
DATE dtValue; 
LONG lvalue ; 

15 double dValue; 

f or ( int inx=0; inx<numFields ; inx+ + ) 

{ 

enumFieldTag fieldID = theMap [inx] .m_universalFieldID; 

20 

switch ( FlPropType ( fieldID ) ) 

{ 

case eFieldType_Binary : 

{ 

// to fill properly, 1st name and last name should already be assigned 

CUniversalField emailField; 
string sValue; 

30 if { SUCCEEDED (Bui IdEmail Fie Id { pAccessor, 

sValue, emailField )) ) 

univRec . insert ( fieldID, 

emailField. getBlob ( ) ) ; 

break; 

35 } 

case eFieldType_String : 

if( pAccessor- >GetFieldValue ( fieldID, sValue ) 

) 

40 { 

"if ( 0 — : :_tcslen {sValue . c_str () ) ) 
continue; 



25 



45 ); 



univRec . insert ( fieldID, sValue. c str() 



} 

break; 



case eFieldType_DATE : 
50 if( pAccessor- >GetFieldValue ( fieldID, dtValue 



) ) 



univRec . insert ( fieldID, dtValue 

break ; 



55 case eFieldType_DWORD: 

iff pAccessor- >GetFieldValue { fieldID, lvalue } 

) 

univRec . insert ( fieldID, lvalue ); 

break; 
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ca.se eFieldType_Double : 

if( pAccessor->GetFieldValue { fieldID, dValue ) 

univRec . insert ( fieldID, dValue ); 

break ; 



H RESULT CBaseAOSTableCCI: :InsertRecord( Mappingltem theMapU, int 
numFields, CDataAccessor *plnsertltem, CFlItemUniversal *pUnivItem, bool 
bForceCreate ) 
{ 

bool bHasData = SetRecordFields ( theMap, numFields, plnsertltem, 
pUnivItem ) ; 



if ( bHasData | | bForceCreate ) 
{ 

plnsertltem- >InsertRow ( 0 ) 
p!nsertItem->Exec ( } ,- 



return S__OK; 

} 



/* 

* Function: SetRecordFields 

* Description: Map fields from an UniversalRecord format into an Oracle 
database record (plnsertltem) 

*/ 

bool CBaseAOSTableOCI: : SetRecordFields ( Mappingltem theMap[], int 
numFields, CDataAccessor *plnsertltem, CFlItemUniversal *pUnivItem ) 

bool bHasData = false; 
CUniversalField field; 

for( int inx=0; inx<numFields ; inx++ } 
{ 

enumFieldTag fieldID = theMap [inx] . m_univer sal FieldID; 
BOOL bSxists = pUnivltem->m_record.Find( fieldID, field ); 
if{ bExists ) 

{ 

bHasData = true ; 
if( field. isBlobO ) 
{ 

string blob = field. getBlob { ) ; 
LPCTSTR szEmailAddr = 
GetAddressFromRecipients { (F1RECIPIENTS*) blob. c__str ( ) ) ; 

if ( szEmailAddr && *szEmailAddr 1= NULL ) 
plnsertltem- >SetFieldValue { fieldID, 

(string) szEmailAddr ); 

else 

{ 

bHasData = false; 
continue ; 

} 
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10 



15 



20 



25 



sValue ) 



dValue ) 



} 



} 

else if{ field . isString { } ) 

{ 

string sValue = field . getString () ; 
if ( ! sValue . empty ( ) ) 

pInsertItem->SetFieldValue ( f ieldID, 

} 

else if ( field. isLong ( ) ) 

{ 

LONG nValue = f ield . get Long (} ; 
pInsert!tera->SetFieldValue { fieldID, nValue) 



else if { field. isDate ( ) ) 
{ 

DATE dValue = f ield. getDate { ) ; 
if ( dValue ) 

p!nsertItem->SetFieldValue ( f ieldID, 



// if{ bExists 



} // For all fields 
return bHasData; 



30 While the above-identified code is specific to, for example, an Oracle 

database, one of average skill in the art will readily recognize that the 
technique utilized above may be adapted to other types of databases 
containing records and fields of interest. In the above code examples, all 
fields which are mapped from a particular application are mapped to fields in 

35 the master mapping file. 



Management Server 

In order to provide security and identification of particular users in an 
Internet-implemented synchronization system, a management server may be 
40 provided in the system of the present invention. The management server is 
a centralized server which controls behavior and characteristics of the entire 
network of device engines across all users. 

Figure 14 shows the general representation of how a management 
server 1410 integrates itself into the system of the present invention. Shown 
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in Figure 14 is an exemplary device engine 1450 which has HTTP links to both 
a management server 1410, a storage server 1415, and a generic FTP server 
1420. As will be discussed hereinafter with reference to the process of the 
present invention, and the specific implementation of the data below shown in 
5 Figures 15-17, the management server interacts with the device engine to 
control authorized access to information on the storage server, or a generic 
FTP server 1420,1425 to access device-specific information storage 1430 in 
accordance with the system of the present invention. This allows any device 
coupling to the Internet to have access to management protocols and to retain 
10 user information across all platforms which the data which is being synched 
by the system of the present invention must access. 

The management server communicates using hypertext transfer 
protocol (HTTP) which may be implemented with a secure sockets layer (SSL) 
to ensure security. 

15 In particular, the management server supports an authentication 

interface that requires each device engine to authenticate with the 
management server before performing synchronization. Certain storage 
server implementations may utilize locking semantics to control read and write 
access to storage for multiple device engines. For example, in a generic FTP 

20 request, if two device engines attempt to connect to the same data at the 
same time, there must be some "form of locking control to prevent device 
engines accessing the same data at the same time. In this instance, the 
management server controls the device engine acquisition, renewal, and 
releasing of locks against data stored in the network. 

25 Each device engine is uniquely identified and tracked by the 

management server. This allows for tailoring behavior between the 
management server and specific types of storage systems and device engine 
components. All device engine components are tagged and version stamped 
for management via the management server. 

30 Device actions can request updated copies of individual device engine 
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components, permitting self-update and configuration of device engine 
systems. This permits minimal download designs for device engines that are 
on low bandwidth connections enabling the device engines to download 
additional required components at a later time. 
5 In a further aspect of the system, a value added component may be 

provided where the management server can support client's advertising 
mechanisms, enabling the display of banner or similar advertising on a device 
engine system without the need for a web browser. Cycling of 
advertisements, statistic collection, and the like, are managed via 

1 0 management server protocols. Online purchase and subscription mechanisms 
are also supported using the management server protocol. 

The management server further supports the accounting, sign-up 
registration, device edition, storage server selection, and similar functions for 
each user in the system. In one embodiment, the management server may 

15 retain password and encryption information for a given user account. In a 
second embodiment, such information is not retained. The second 
embodiment provides the advantage that users may feel more secure if the 
maintainer of the management server is not in possession of the password to 
access data in the user's account. 

20 Further information with respect to the management server and the 

data flow from the management server to other components of the system of 
the present invention will become apparent with respect to the discussion of 
the process flow and data flow diagrams in Figures 15-17. 

Figure 17 shows a general depiction of the data flow and the functional 

25 specification of the management server utilized in accordance with the present 
invention. 

As shown in Figure 17, following a welcome request 1710, a user is 
allowed to sign out which enables an add user module 1712, and 
subsequently enables an add device module 1714. If sign-up is not 
30 requested, information may be provided via module 1718. 
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As indicated in Figure 17, the add user module 1712 adds user records 
to the user in device database 1750. Additionally, the add device module 
1714 adds users and devices to the user device database 1750. A device list 
1720, and a device engine download and update database 1722, provide 
5 selection data for the add device module 1714. The account authentication 
module 1724 receives input both directly from a user log-in from the welcome 
screen at 1710 and from the add device module 1714. 

Once an account is authenticated and confirmed, the administrator of 
the system of the present invention having a private data store at 1770 may 

10 choose to provide a web desktop 1754 which allows access to a user's 
records such as file 1756, e-mail 1758, calendar 1760, contacts 1762, notes 
1764, and tasks 1766. The information will be culled from a provider database 
1752 which will be synched in accordance with the system of the present 
invention as previously described. In essence, the provider database 1752 

15 accesses data from the device engines 1780, which include, as discussed 
above, the storage server, each individual device engine 1785, and a settings 
database 1787. 

Other portions of the management server include the locking modules 
for beginning a sync 1732, continuing a sync 1734, and ending a sync 1736, 
20 and for updating user information including modifying a user 1742, adding 
devices 1744, removing devices 1746, and modifying devices 1748. 

Storage Server 

Shown in Figure 14 is the storage server 1415. While storage server 
25 1415 may include a generic storage model accessible through any number of 
standard Internet protocols, in accordance with the present invention, a flexible 
storage architecture is provided that permits various standard implementations 
of the system of the present invention. This allows deployment of network 
services without installation of new server applications and can be responsible 
30 for communicating change information between multiple device engines in a 
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consistent fashion. 

One or more storage servers 1415 may be used to communicate 
transaction amongst a collection of devices. Each user's personal information 
network is represented by a unique account within its own data package 
5 storage section. The storage server 141 5 maintains persistent store collection 
of data packages which is, at a minimum, enough data packages to be 
capable of synchronizing the most out-of-date system in a user's given 
information network or add information to new devices which are provided in 
the network. Additional data packages can be maintained to permit rollback 
10 of previous versions of information. The storage server can automatically 
dispose of older data package storage and can support aging of an inactive 
accounts. 

Each storage server 1415 may be implemented using a variety of 
implementations including a standard FTP server for any operating system 

15 platform. The storage server can be implemented using HTTP protocols for 
increased efficiency and firewall avoidance. The storage server may be 
implemented using techniques for local storage such as database access or 
single file storage of a user's entire file system tree. The storage server 1415 
may utilize the stored foreign protocol model for moving copies of data 

20 packages to other storage servers in the system. In one embodiment, the 
storage server can allow tunneling of information using an alternative protocol 
to other storage servers in cases where firewall prevents originating protocol. 
For example, a storage server can relay an FTP traffic inside an HTTP 
protocol. Storage servers may include their own locking semantics to arbitrate 

25 multiple device engine access to the same server without the need for a 
separate management server. Each device engine can access only a specific 
user's data package storage area even though the storage server 1415 may 
maintain a larger number of data packages across a large number of users. 
This allows for increased scaling when the storage server is implemented 

30 using file system techniques. 
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In one aspect, the storage server is implemented using standard FTP 
or HTTP connections for each operation. HTTP is composed of request 
response pairs. All requests are supposed to be posting commands. 
Parameters can be set in the form known as "application/X-WWW-form- 
5 URLENCODED". The encoding is specified as in RFC1866. Functions for the 
storage server include testing if the storage server can reach other users 
which will retrieve a simple text string, a "get" command which transfers the 
contents of a file as in a binary stream of byes; a put command as a binary 
stream of data to the storage server, a directory listing command, a remove 
10 command, a rename command, an exist command, and the like. 

Pull Synchronization 

Figure 15 represents a "pull" synchronization process in accordance 
with the present invention. Both the pull synchronization illustrated in Figure 

15 15 and the push synchronization illustrated in Figure 16 are done from the 
perspective of the device engine. 

A pull synchronization as illustrated in Figure 15 is always performed 
prior to a push synchronization. This allows the device engine to know 
whether synchronization of its own data is necessary. 

20 Each device has its own triggering mechanism for initiating 

synchronization. Some devices, such as Windows clients and Palm® pilots 
are triggered manually when the user presses a "sync" button. Other devices, 
such as a cellular telephone, may be triggered automatically after another 
device completes a sync. Regular, time-based triggers are supported as well. 

25 A web-based application portal will sync when a user logs into the website 
security authorization mechanism, and may optionally sync on a log-out of the 
user or on the session time-out, but only if the user has changed data during 
the session. 

For each sync, the triggering event specifies which application types 
30 are to sync for the device. This enables a triggering event to trigger only a 
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sync for a particular application type. The management server can specify 
that no sync is needed for a particular type of application to minimize traffic to 
the storage server. Syncs may be triggered via an HTTP request to the 
server. This request holds information about which device to sync and the 
5 user log-in information is bounced to the management server for authorization 
and validation. Syncs may be triggered by sending an HTTP request to the 
server and passing the authentication information in the data portion of the 
request to the management server. Each device may include a servlet that is 
responsible for retrieving the request and ensuring its proper format before 

10 passing the synchronization request on to the server. 

The device name and device class uniquely identify a particular device 
type that is being synchronized, and is contained in the management server. 
Each user has one or more device entries in the management server 
authorization records and each device name is unique for this user's space. 

15 For example, if a user has five devices with his or her own personal 
identification number, there will be five authorization records. There may be 
two Windows devices, two different Palm® devices and a web service portal, 
each having their own personal identification number. 

As shown in Figure 1 5, the pull synchronization process starts at an idle 

20 state 1405 when the triggering event, described above, triggers a 
synchronization request. The synchronization request is confirmed at 1410 
and if the request is verified, a connection is made to the storage server at 
step 1415. Once a connection is established, the connection to the 
management server is made at step 1420 to authenticate the user 

25 identification via the management server. If authentication is successful, the 
management server may initiate a management server lock on the storage 
server so that no conflicting device engines may couple to the same data at 
the same time. A failure at any of the steps 1410-1425 will return the system 
to its idle state 1405. Once the engine server lock is acquired, the storage 

30 server will be checked to determine whether a new version of the data exists 
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on the storage server at step 1430. If no new version exists, the 
synchronization process ends. 

If a new version of the data exists, the device engine will retrieve the 
difference information at step 1435 "to get A." 
5 Once a A is retrieved, conflicts are resolved at step 1450. The resolve 

conflicts step allows a user to resolve conflicts to multiple types of data which 
have been changed on both the server portion of the device and in the local 
data. 

Once the conflicts have been resolved at step 1450, the A's are applied 
10 at step 1455. The apply A step 1455 allows for filters and mappings to be 
accounted for on the local device engine side of the system. As shown at 
steps 1460, 1465, 1470, and 1475, the A may include updates at the item level 
1460, application level 1465, device level 1470, or network level 1475. In 
each of the aforementioned steps, a loop back to the A retrieval step 1435 is 
1 5 provided. When no further A's are available, the management server lock is 
released at step 1440. 

The foregoing description of a pull synchronization is further described 
in the following pseudo-code: 

20 * Symbol icSyncEngine : :Sync 

Download Remote File System 

For each Symbolic app in the file system's list of symbolic apps 

25 

CFDESymbolicSyncSngine : : Sync Symbol icApp 

Create a structured delta object -- CStructuredDelta 

delta { . . . ) 

30 

Compare local and remote versions of deltas SODs) , 

if not the same then 

35 while localVersion != remoteVersion 

download remote version 

// apply delta (change log) 
40 de 1 ta . App lyChangeLog 

// See details below 
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increment local version 
end while 

else 

nothing to do 

end if 

if any local items (change logs) are unsent then 

delta- >ApplyUnsentI terns (Reads the changes [JCL 

where applied?] 

end if 



// Generate a new change log for the device: 
delta- >delta . GenerateChangeLog ( . . . strChangeLogFile 
. . . ) // See details below 

FTP it back up to Storage Server 

Update the local version number 

end // Symbol i cSyncEng ine :: Sync Symbol icApp 

end // CFDESymbolicSyncEngine : : Sync 

CStructuredDelta : : Apply Change Log 

Set up m_pAppObj ; // IFAO pointer 

Set up mj)AOS ; // IAOS pointer 

Other set up (statistics, time to complete, etc.) 

Read the change log and . . . 

App 1 y Change ListToAOS (f 1 Changes) 
for each itme in list 

ApplyltemToAOS // (Does 
m_pAOS . . .AddRecord/UpdateRecord/DeleteRecord) 
end for 

end // Apply Change ListToAOS 

If not doing a full sync, also add changes from this file to apply 
these to m_Fl Changes 

end //CStructuredDelta: : Apply Change Log 



CStructuredDelta : : GenerateChangeLog 

Set up m_pAppObj ; // IFAO pointer 

Set up m_pAOS; // IAOS pointer 

Other set up (statistics/ time to complete, etc.) 
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// Set up m_dev ice Changes by call to: 
CStructuredDelta : : CreateDeviceChangeList 

Create a CFlItem* pltem 

// Iterate FAO modifications: 
for (m_pAppObj - >GetFirstModif ied {pltem) , 
m_pAppObj - >GetNextModif ied (pltem) ) 

cast pltem to --> CFlItemUniversal* pUniltem 

// Do certain things based on whether the operation is 
an add, delete, or update. 

// Then in each case, call: 

CStructuredDelta : : GetMatchingltemFromAOS 

// First get by F1ID 
m_j>AOS->GetRecordByFHD 

// See if we have an AppID, if so: 
m_j?AOS - >GetRecordByAppID 



// If we can build search key on it 
iterate m_pAOS- >Get Firs tMatching Re cord / 

m__pAOS->GetNextMatchingRecord 

end // CStructuredDelta: : GetMatchingltemFromAOS 

end for 

end // CStructuredDelta :: CreateDeviceChangeList 

if m_deviceChanges is not empty 

// reconcile (compare) change lists while writing to AOS 
CStructuredDelta : : ReconcileChangeLists 

For each item in m_de vice Changes . 

If we can find it in m_FlChanges 

Reconcile the device item and the fl 

end if 

Apply I temToAOS // (Does 
AddRecord/UpdateRecord/DeleteRecord) 
end for 

end // CStructuredDelta: : ReconcileChangeLists 



item 

m_jpAOS . . . 



II Create a new change log (Fl delta package) 
Appl yChangeL i stToF 1 ( m_de vi ceChange s ) 
m_device Change . Store 

// Fires off its own whole world, see 

FlItemList . cpp 

end / / m_devi ceChange . Store 
end // ApplyChangeListToFl (m_devi ceChange s) 
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report stats 

end if 

5 // Switch (SyncMode) 

If SyncMode == full 

ApplyAOSToDevice 

iterate m_pAOS->GetFirstRecord. . . m_pAOS- >GetNextRecord 
Add or update the corresponding FAO record. 
10 (Note. Never delete based on what's in AOS, apparently). 

end // ApplyAOSToDevied 

else 

ApplyChangeListToDevice (m_f 1 Change s ) ; 
15 End // CStructuredDelta : :GenerateChangeLog 



Push Synchronization 

Figure 1 6 shows a push synchronization in accordance with the system 

20 and method of the present invention. Beginning at idle state 1505, a 
synchronization event occurs and if confirmed at step 1510, A's are checked 
at step 1515. Depending on which type of changes occurred, a network A 
1520, device A 1525, location A 1530, or item A 1535 will be created. 

Once the A's for a given application have been created, the method of 

25 the present invention continues at step 1540, which enables a connection to 
a storage server. Upon connection to the storage server, a further connection 
to management server 1545 will occur to authenticate the user in the system. 
Failure at any of the aforementioned points will result in returning to idle state 
1505. Upon authentication, a management server lock is enabled to ensure 

30 that multiple device engines do not connect to the same data at the same 
time. 

Once a lock is acquired at step 1555, A's are uploaded to the system. 
As shown, this may include uploading an item A 1575, an application A 1570, 
uploading a device A 1565, or a network A 1560. Once A's have been 
35 uploaded to the server, management lock server 1580 is released, and the 
connection to the storage server is terminated at step 1585. 

It should be recognized that such a push synchronization need not 
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occur directly to a server, but may occur directly to a second device engine in 
accordance with the depiction of the multiple embodiments of the invention in 
Figures 1-7. 

5 Data Package Specification 

Once information is provided into the universal data format, the device 
engine organizes the format into a data package. Each data package thus 
includes a description of changes to any and all information for particular 
application, and a collection of data packages describes changes across all 
10 device engines including all different types of data. With encoding and 
compression, data packages can become very compact to minimize 
bandwidth and storage requirements across the system of the present 
invention. 

In one particular aspect of the present invention, encoding of the data 
1 5 packages may be provided in a streaming format to allow processing by the 
device engines with minimal storage and memory configuration at the device 
engine level. 

The device engine can read the stream and determine which records 
from which applications it needs to update the particular information present 

20 on the system on which it resides. 

Data packages can be provided in a binary data format. This allows 
data packages to encode changes to non-application data at a bite level. 
Hence, if a single bit on a system changes, the system of the present 
invention allows synchronization of that bit on another system. Changes are 

25 described as a sequence of bite-level change operations. One such encoding 
is using a sequence of insert and copy operations. Insert and copy operations 
generally define a particular "insertion" of a number of bites from a source file, 
then how many bites of a changed source file must be inserted to a particular 
file, then how many bites to insert from a particular new file, with a differencing 

30 engine taking the bites in the stream and inserting them into the new file to 
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create the new version of the file. 

As will be readily understood by one of average skill in the art, this 
allows a user to, for example, change a binary file such as a word processing 
document or other type of attachment, and synchronize such an attachment 
5 at the binary level. Specifically, if one forwards an e-mail of a word document 
to a second individual, the second individual modifies it and wishes to return 
this document with modifications to the first individual, because the first 
individual has the original file on his system, if both systems are enabled in the 
system of the present invention, the second system need only send the 

1 0 changes or the difference information back to the first system in order for the 
first system to reconstruct the document on the second system using this 
change data to create the document as intended by the second user. 

Multiple caching of both the generation and application of data 
packages can be utilized to deal with communication issues in accordance 

1 5 with the system of the present invention. It should be further recognized that 
data packages can be merged into larger meta-data packages. Such meta- 
data information, such as the organization of multiple device packages, may 
be encoded into a larger system package. Each system package is 
essentially an encoded sequence of data packages. 

20 Figure 12 shows the general format of the data package and universal 

data format an object stream hierarchy used in accordance with the present 
invention. With reference to Figures 1 1 and 12, one will note that each item 
in a particular application data structure will have a particular classification, 
such as a file, folder, contact, e-mail, calendar, etc. as shown in Figure 13. 

25 The universal data structure contains a mapped item field for each type of data 
possible from each application supported by the system. Hence a "master* list 
of every data field mapping possible will contain a large number of items. 
Each application object requires a subset of such fields. One exception is an 
application object used for a Web portal application which provides access to 

30 all information available on all devices, including other Web portals. 
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Particular examples of item fields 1 260 which may be included for any 
given item 1250 are shown in Figure 13. These exemplary item objects may, 
for example, be from an allocation such as Microsoft Outlook. Outlook allows 
for note items 1310, e-mail items 1320, task items 1330, calendar items 1340, 
5 bookmark items 1 350, file items 1 360, channel items 1 370, folder items 1 380, 
and contact items 1390, all of which have fields such as those represented in 
Figure 13. 

The data format also contains folder information 1 240 which allows the 
classification of items and consequently their associated item fields into 
1 0 particular categories. 

Application objects 1230 include information on the types of 
applications from which information in the stream is included. Device objects 
1220 include information on the origin type of device which the information is 
originating from. Network objects 1210 include information on a user level to 
1 5 define that the information in the data stream is coming from a particular user. 

As detailed above, each application object supports a folder store 
interface that permits management of collections of information on a folder 
level, and permits management of folder hierarchies of information. The 
application object also includes an item interface that permits management of 
20 individual information entries such as records or files or components of 
information entries such as fields within records. Each application object 
further supports an interface for detection of a vendor application. 

A DataPack essentially contains a sequence of transactions describing 
changes to information. This information can span two basic types: structured 
25 or application data, and unstructured or binary file data. 

Transactions are encoded using an efficient streaming format with tags 
to represent the actual content objects. This technique permits the continuous 
extension of the DataPack format as new content is supported. 

The general architecture of the package provides for transactions, 
30 application data, file data, files, objects and identifiers to be carried in the data 
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package. Generally, transactions, application data, file data, and files have 
previously been described. 

The first portion of the data package will be the data package identifier. 
Each transaction has a basic architecture of objects and operations. Each 
5 piece of content is referred to as an object and is uniquely represented with a 
Universally Unique Identifier (UUID). Objects typically are represented by a 
dynamically generated UUID, but more common objects are represented by 
static UUIDs. The following static UUIDs are defined: 



10 UUID_GenericDe fault Folder 

UUID_Def aultCont act Folder 
UUID_Def aultlnboxFolder 
UUIDJDefaultOutboxFolder 
UUID_DefaultDraftsFolder 

1 5 UUID_Def aultTrashFolder 

UUID_DefaultSentFolder 
UUID_DefaultCalendarFolder 
UUID_Def aultTaskFolder 
UUID_DefaultNoteFolder 

20 UUI D_De fault Jour na 1 Fo 1 de r 

UUlD_DefaultFavoriteFolder 
UUID_DefaultCookieFolder 
UUID__DefaultHistoryFolder 
UU I D_De f au 1 1 Channe 1 Fo 1 de r 

25 UUID_DefaultFileFolder 
UUID DefaultCallFolder 



Each UUID has a unique 128 bit value which may be assigned by the 
system provider. 

30 Transactions are broken down into manageable blocks in the form of 

individual files. These files are then optionally compressed and encrypted and 
prefixed with appropriate headers. Transactions are grouped into specific files 
based on the following rules: 

• Transactions related to account information are grouped into a 
35 DataPack file. 

Transactions related to a specific data class are grouped into a 
DataPack file. 

Transactions referring to binary data are grouped into separate 
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DataPack files for each file object. 
A DataPack file is identified using specific rules based on the file name. 
The file name is of the form "UUID.VER" where UUID is the identifier for the 
specific object and VER is the transaction version number. The version 
5 number is of the form "D0001" with additional digits used for large version 
numbers. The "D000" value may be reserved for the base version for the 
object. 

The UUID for the user account is generated by the Management Server 
(MS). The MS also maintains a current table of UUID values and version 
1 0 numbers that provides the root structure for understanding the DataPack files 
within a user account. The MS also provides necessary locking semantics 
needed to maintain consistency when multiple device engines attempt to 
synchronize. 

All DataPacks are prefixed with a standardized header that provides 
15 basic content information regarding the DataPack. Compression and 
encryption headers follow the DataPack header if needed. 

The data package header information will include version signature, 
applied versioning information, content type, A engine type, compression 
type, encryption type, applied size, encrypted size, compressed size, raw data 
20 size, and other data useful for the device engine in decrypting the data stream 
to provide the data into a format usable for the application. 
The header may optimally have the format: 



Type 


Bytes 


Version 


4 


Signature 


4 


AppiiedVersion 


8 


ContentType 


4 


DeltaType 


4 


CompressionType 


4 
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EncryptionType 


4 


AppliedSize 


4 


EncryptedSize 


4 


CompressedSize 


4 


RawSize 


4 


Reserved 


TBD 



The following ContentType values are permissible: 



Field 


Comment 


DP_CONTENT_RAW 


Raw 


DP_CONTENT_COMPRESSED 


Compressed 


DP_CONTENT_ENCRYPTED 


Encrypted 



1 5 The DeltaType encodes the type of binary file differencing used. The 

following DeltaType values are permissible using DataPackageDeltaType: 



Field 


Comment 


PackageDeltaTypeUninitialized 


Uninitialized 


PackageDeltaTypeRawData 


Raw binary data 


PackageDeltaTypeDeltaXDelta 


Xdelta binary difference 


PackageDeltaTypeDeltaBDiff 


Bdiff binary difference 



The compression type specifies whether the DataPack has been 
25 compressed. A DataPack compression header follows the DataPack header 
if a compression type is specified. The following CompressionType values 
are permissible using DataPackageCompressionType: 



Field 


Comment 


PackageCompressionTypeUninitialized 


Uninitialized 
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PackageCompressionTypeNone 


None 


PackageCompressionTypePK 


PKZip format 


PackageCompressionTypeLZS 


LZS format 



5 The encryption type specifies whether the DataPack has been 

encrypted. A DataPack encryption header follows the DataPack header if 
an encryption type is specified. The following EncryptionType values are 
permissible using DataPackageEncryptionType: 



10 



Field 


Comment 


PackageEncryptionTypelininitialized 


Uninitialized 


PackageEncryptionTypeNone 


None 


PackageEncryptionTypeXORTest 


XOR masked data 


PackageEncryptionTypeBiowFish 


Btowfish 


Package EncryptionTypeTwo Fish 


Twofish 



Ail DataPack compression headers are encoded using the following 
format: 

20 



Field 


Size (bytes) 


Comment 


Size 


4 


Size of data including this header 


Version 


4 


Version (1) 


Signature 


4 


Signature (4271) 


HeaderType 


4 


Header type (HeaderTypeCompression) 


Reserved 


12 


Reserved 


Decompressed Size 


4 


Decompressed size 


Reserved 


50 


Reserved 


Reserved 


12 


Reserved 



30 

The following HeaderType values are permissible using 
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DataPackageHeaderType: 



Field 


Comment 


HeaderTypeUninitialized 


Uninitialized 


HeaderTypeEncryption 


Encryption header 


HeaderTypeCompression 


Compression header 


HeaderTypeRaw 


' Raw header 



10 

All DataPack encryption headers are encoded using the following 
format: 



Field 


Size (bytes) 


Comment 


Size 


4 


Size of data including this header 


Version 


4 


Version (6) 


Signature 


4 


Signature (4270) 


HeaderType 


4 


Header type (HeaderTypeEncryption) 


Reserved 


12 


Reserved 


DecryptedSize 


4 


Decrypted size 


InitValue 


16 


TBD 


KeyLength 


4 


TBD 


ClearTextKeyBits 


4 


TBD 


Salt 


4 


TBD 


PadBytes 


4 


TBD 


HMAC 


20 


TBD 


Reserved 


12 


Reserved 



The data package transaction format may take a number of forms. 
30 One example is the following: 



DataPack transaction format - header - info - objects and operations 
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Diagram 

transaction ::= fileData | Header + InfoList + Transact ionList 
fileData::= raw binary file data | binary difference data 

Header ID + DataPackID + DataPackVersion 

ID : : = FUSE 
DataPackID : : = CLOG 

InfoList = FieldList 

Transact ionList ::= Operation + [Itemlnfo + [FieldList]] 
Operation ::= see table below 

Itemlnfo ::= ItemType + ItemFlags + EntrylD + ParentEntrylD 
ItemType : : = same as enumltemType 
ItemFlags ::= same as enumFl ItemFlags 

EntrylD : : = UUID 
ParentEntrylD ::= UUID 

UUID : := 12 8 -bit UUID as defined by standard 

FieldList {FieldTag + FieldData} + ListEnd 

FieldTag ::= same as emimFieldTag 

FieldData ::= FieldDataType + [FieldDataLen + [FieldDataData] ] 
FieldDataType : := see below 

FieldDataLen : : = length as required by FieldDataType 
FieldDataData : := data as required by FieldDataType 
ListEnd ::= DWORD (0) 



The following Operation values are permissible using the Operation 

class: 



Field 


Comment 


cINop 


None 


clAdd 


Add 


cl Delete 


Delete 


cIChange 


Change 


clMove 


Move 


ciRename 


Rename 


clForceChange 


Force change without conflict 



The following FieldDataType values are permissible using 
cIDataType: 
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Field 


Comment 


clinvaJidType 


TBD 


cIString 


Unicode String bytes with a 32-bit length prefix 


clString8 


Unicode String bytes with an 8-bit length prefix 


cIString 16 


Unicode String bytes with a 16-bit length prefix 


clEmpty String 


TBD 


ciBlob 


32-bit length followed by a byte stream 


clB!ob8 


8-bit length followed by a byte stream 


ciBlob16 


16-bit length followed by a byte stream 


ciEmptyBfob 


TBD 


clByte 


8-bit value 


clShort 


16-bit value 


clDword 


32-bit value 


clQword 


64-bit value 


ciDate 


DATE type (double) 


cIDoubie 


8 byte real 


clFloat 


4 byte real 


clUuid 


16 byte uuid 


ciZero 


Zero value 


clOne 


One value 


clUnspecified 


Unspecified value 


ciDefault 


Default value 


cICoilection 


Collection with 32-bit length 


ciCollection8 


Collection with 8-bit length 


cICoilection 16 


Collection with 16-bit length 


clEmptyCollection 


Collection with no length 



Data package objects are organized into a hierarchy as follows: 

Account: := DeviceList + DataClassList 
DeviceList : : = {Device} 

DataClassList :: = {DataClass} + ProviderList 
ProviderList :: = {Provider} + DataStoreList 
DataStoreList : : = {Folder} + ItemList 
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ItemList::= {item} + PieldList 
FieldList::= {Field} 

An account is the root structure, which identifies information about 
the user's account. It may have exemplary field tags (eFieldTag JNAME]) 
such as Name, Password, UserName and Version. The FieldTag 
ItemType value is specified as ltemType_PIN using enumltemType. 

A device is a system identified as part of an account. Examples 
include PCs, handhelds, Web sites, and so on. It may have tags 
(eFieidTagJName]) such as: "name" and "type" and item type values 
(eDeviceJName]) such as Portal, Palm, Windows, CellPhone. 

A data class is a grouping of similar information types. Many data 
classes may be represented for a particular account. The data class may 
contain field tags (eFieidTagJName]) such as: Name; ItemType; SubType; 
IsManaged; Provider; Filter and Version. 

The following ItemType values are permissible using enumDataClass 
(eDataClassJName]): 



Tag 


Description 


UNKNOWN 


Unknown 


CONTACT 


Contact/address book 


EMAIL 


Electronic mail 


CALENDAR 


Calendar 


TASK 


Task/to do 


NOTE 


Note/memo 


JOURNAL 


Journal 


BROWSER 


Web browser favorites, cookies, etc. 


FILESET 


Collection of files 


PIN 


Account information 


DEVICE 


Device information 


F1LEBODY 


Contents of file 
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A Provider is the application that maintains specific information within 
a data class. There can be more than one provider for a particular data 
class. Field tags include: Name, AppObjID, Password, Username and 
Version. Examples of provider tags permissible for the provider 
5 (eProvider[Name]) include: Portal, Palm®, MicrosoftOutlook®, Lotus 
Organizer, Microsoft Internet Explorer, Microsoft Windows, and so on. 

Data stores are the containers for storing information within a 
provider. There can be more than one data store for a particular provider. 
Folders represent structural organization of information within a data store. 
1 0 Data stores are not required to support folders. Tags (eFieldTag_[Namej) 
supported for each data store include: Name, ItemType, IsManaged and 
OriginalPath. Item types permissible for the data store include: unknown; 
Folder; MAPI; Database and Store_File. 

Folders represent structural organization of information within a data 
15 store. Data stores are not required to support folders. A folder is 
represented by a UUID and may contain any of the following field tags 
(eFieldTagJName]): Name; ItemType; IsManaged; File Attributes; 
CreationDate; ModificationDate; AccessDate; SpecialFolderType. 

The eFieldTag JtemType value is specified as eltemType_FOLDER 
20 using enumltemType. 

Items are individual informational components consisting of the 
actual user data. They may contain field tags such as: Name, ItemType, 
IsManaged, and Version. 

File items typically have the following additional field tags 
25 (eFieldTagJName]): 

FileAt tributes 
CreationDate 
ModificationDate 
AccessDate 
30 FileSize 
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FileBody 

DeltaSize 

Hash 



5 Item types may take the format (eltemType_[Name]) and may 

include: extended; folder; attachment; contact; distiist; email; calendar; 

task; call; note; post; journal; form; script; rule; favorites; subscription; 

common_favorites; desktop; common_desktop; startmenu; 

common_startmenu; channels; cookies; programs; common_programs; 
10 startup; common_startup; sendto; recent; internet_cache; history; 

mappedjj rives; printers; docs; doctemplates; fonts; window__settings; 

app_data_folder; app^settings; fileset; pin; device; data__store; file; 

provider; and data_class; internal. 

A field is based on one of a set of base type definitions. AH field tag 
15 information is encoded using the following format: 



Field 


Size (bits) 


Comment 


FieldTag 


16 


Unique tag number 


FieldType 


6 


Field base type 


FieidSubType 


10 


Field sub-type 



A number of Field types are possible, including: unknown; long; 
dword; date; string; binary; float; double; collection; uniqueid; qword; uuid; 
file; invalid. LONG is a four byte value encoded in big-endian format. 

25 FieldType DWORD is a four byte value encoded in big-endian format. 
FieldType String is a sequence of Unicode characters followed by a single 
NULL byte. Interfaces are provided with an MBCS value. FieldType 
Binary is a sequence of bytes. FieldType UniqueiD is a sequence of bytes 
as defined by the Universally Unique Identifier (UUID) standard. AO 

30 interfaces are provided with a Locally Unique Identifier (LUID) value 
FieldType QWORD is an eight byte value encoded in big-endian format. 
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10 



FieidType File is a UUID that references a separate DataPack containing 
the file body data. AO interfaces are provided with a sequence of Unicode 
characters followed by a single NULL byte that describes the full path 
name for the file. 

Any number of filed sub types are possible. Each of the sub-types 
includes all of the possible data types from all of the supported user 
applications. As should be well understood, the possibilities in the number 
of sub-types is quite large, and dynamic as each new application supported 
by the system of the present invention is added. Examples of sub-types 
include: 



15 



20 



25 



30 



35 



SubField Description 
Base 

Email Address 

Ema i lAddr e s sL i s t 

SearchKey 

CategoryList 

StringList 

DistributionList 

Gender 

TimeZone 

Boolean 

NonZeroBool 

Priority 
Sensitivity 
Importance 
SelectedMailingAddr 

TaskStatus 
FlagStatus 
RecurrenceType 
DayOfWeek 
DayOf Month 
Inst anceOf Month 



Description 

No sub- type specified 

Email address 

Email address list 

Search key 

Category list 

String list 

Distribution list 

Gender (enumGender ) 

Time zone (enumTimeZone) 

Boolean (TBD) 

-Boolean with non-zero value 
( enumNonZeroBool ) 

Priority 

Sensitivity (enumSensitivity) 

Importance (enumlmportance) 

Selected mailing address 
{ enumS e 1 ec t e dMa i 1 i ngAddr ) 

Task status (enumTaskStatus) 

Flag status {enumFlagStatus) 

Recurrence type (enumRecurrenceType) 

Day of week (enumDayOfWeek) 

Day of month (1 through 31) 

Instance of month 

( enumlnstanceOf Month) 
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MonthOfYear 

BusyStatus 

At t a c hme n t Type 

MailBodyType 

RGB 

Manage dSt ate 
Faold 

SpecialFolde rType 

Re spons estate 

ResponseStatus 

Journals tatus 

PageStyle 

PageNumbe rMe thod 

DelegationState 

Meet ingSt atus 

Meet inglnvi tat ion 

Calenda rType 

DateOnly 

TimeOnly 

PhoneNumber 

URL 

FilePath 
PopMessagelD 
MIMEType 
INVALID 



Month of year (enumMonthOf Year) 
Busy status ( enumBusyS tatus ) 
Attachment type (enumAttachmentType) 
Mail body type (enuraMailBodyType) 
RGB color value 

Managed state (enumManagedState) 

FAO ID for provider 

Special folder type 
(enumSpecialFolderType) 

Response state (TBD) 

Response status (TBD) 

Journal status 

Page style 

Page number method 

Delegation state 

Meeting status 

Meeting invitation 

Calendar type 

Date only 

Time only 

Phone number 

URL 

File path 

POP message ID 

MIME type 

All values must be below this 



The aforementioned invention provides a user-centric model of 
communication to deliver personal information via network services. This 
model accommodates devices that are disconnected from the network, 
such as the Internet, at various times. Personal information can continue 
to exist locally rather than imposing a server-centric model on existing 
information. 

In accordance with the foregoing, a store and forward information 
broadcast is utilized. Changes to existing information are replicated to an 
Internet storage server and changes are then retrieved by other devices on 
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the network at device-specific times, in this manner, direct client 
communication is accomplished without requiring one-to-one 
communication. While one communication is supported by the system of 
the present invention, it need not be required. 

5 Although the present invention has been presented in the form of an 

Internet store and forward broadcast for the purposes of synchronizing 
personal information amongst various types of devices, it will be readily 
recognized that synchronization need not be accomplished as the only 
application forthe aforementioned system. In particular, the system can be 

10 utilized to efficiently broadcast changes to information in so-called "push" 
type information applications where only portions of the data need to be 
changed on a client application. For example, in a system where 
information such as changes in a stock price need to be broadcast to a 
plurality of users, a client application implementing the aforementioned 

15 technology can be updated by only changing specific portions of the data 
in the client application relative to that particular stock price. This can be 
done using a smaller bandwidth than has previously been determined with 
other devices. 

The many objects and advantages of the present invention will be 
20 readily apparent to one of average skill in the art. All such objects and 
advantages are intended to be within the scope of the invention as defined 
by the written description and drawings presented herein. 
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